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The Institute for the F,uture is an independent research organization, founddd^ 
as a nonprofit corporation for work solely in the public interest. It is'dedicated 
exclusively to systematic and comprehensive study of the long-range future.. 
The Insti|ute*s primary aims, as formulated in its Articles of Incorporatiorii 
are fourfold: 

**. . . to enlarge existing understanding coficerning technological, environmental, 
and societal changes and their long-range consequences; to^develop new 
m^hodology Ute cari^ on such tasfcs; to make available without discrimlnatjon 
' the *sults of such research and scientific advances to the public;*and to serve 
as an educ^tionaU^nd training center for selected persons from business, govern- 
i^nt, foundations, and universities with respect-to such research activities." 

The Institute's research program has two major components: 4}eveJopment of 
forecasting methods for the analysis and synthesis of potential futures, and 
the application'oV sdch methods to the problems of society.^Among the general 
areas of this research are the future state^of the Uhion; the inttuencc of future 
technological devejopmehts on socfctal trends; social indicator and the quality 
' of life; arid^ilong-rangyurbafi and national planryng. More specific topic^jjave 
also been^tj^5min<j||| su<^ as the fj^re^df housing, plastics^ computers, com- ^ 
municMwns,' insurance, education, and employee benefits, ftistitutr research 
genemlly is conducted by means of sijeh futures-analytic techniques ^s. the^ 
Delphi* method, cro'ss^iitpact Analysis, ftid simulation, ^as well as the nriore " 
traditional mctljoda of physical- and social-science research. 
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SUMMARY OF VOLUME II 



This docxament cons'titutes the second research report in a continuing 
investigation of group coinmuni cation via computer networks. An earlier re- 
port* described in detail the design and implementation of a system^^^^^^d 
FORUM; this system has served as the basis for a series of 'field tests de- 
signed to identify the basic parameters of human interaction in canputer- 
based teleconferencing. * 

_^'X:onsiderable interest has been created by the c±>servation that computer 
networJcs might soon link together human participants in cost-effective group 
discussions across geographic and political ^unaaries. In the course of 
the research described here, we have had the opportunity not only to orga- 
nize such' conferences but to evaluate them with en* increasing degree of pre- 
cision. Our results suggest that efficient comm^ication can take place, 
often among persons Who have not previously been 'in c^tact wi^ each other, 
and at what appears to be cost-effect^^ rates. We have found that inter ac- ^ 
tion within conferencing groups has not been related to prior face-td-face 
acquaintance of participants but has represented new patterns of associa- 

'tion. We have established that the integration of large-scale data bases 
within the context of ongoing conferences is technically feasible. Finally, 
we have also observed an increasing trend toward problem- solving activity 
among groups using FORUM, an bbservation which, together with other factor^, 

' has encouraged us to undertake extended experiments in operational settings. 
Ten conferences involving small groups which range in si^e from 3 to 
30 participants are described in detaijL in the present report. The analy- 
sis of these conferences* is based on a taSonomy of ^roup communication 
through* electronic media. This taxonomy has been developed in collaboration 



^Jacques Vallee, Hubert M. Lipinski, and Richard H. Miller, Group Com- 
municaition through Computexs — Volume 1: Design and Use of the FORUM Sys- 
tem, Institute for the Future, Report R-32, July 1974. 
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with a number of other research groups active in this field and has led to 
the identification of a set of speciific statements that describe basic man- 
agerial, social, and economic issues iir coroputer-baseS ^interaction. The 
most significant findings to date^ave been related to the possible impact 
of computer-based communication on work patterns and. its considerable po- 
tential as a novel medium for networks of di|seminated persons. Our cur- 
rent evaluation of its potentials, as w^l-jas^its problems, is presented 
in this report. 

A stat^^ent of statistical results and an extensive bibliography are 
also provided. 
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I. 

I. HUMAN INTERACTION THROUGH ELECTRONIC MEDIA* 

■A 

^ \ ^ . » 

' I ^ 

I '» 

*■ ^ , 

New media of coramuriication have traditionally bp-^ b' the dreams 

of technologists and' released to the general public liccle thought or 

research c6nceming likely social effects or necessary regulation. Initial 
dev^slopment expenditures emphasize technological feasibility and dollar costs 
as measures of utility, with social scientific research used only in later 
stages of analysis. The almost nonexistent literature on the sociology of 
the telephone — invented almost 100 years ago — is only *on© example of this - 
phenonenon. A generally acknowledged' bibliography on^mall group' research 
by McGrath and Altman** contains^ 2^699 entries, only six of which deal with 
situations Other than face-to-face communication. v ' 

Our own involvement in this research began with a computer program 
called FORUM. FORUM functions as a medium of interpersonal communication 
for s«Ch activities as group conferencing, joint writing projects, elec- 
tronic notepads, and questionnaires. It is one of a growing number of 
Computer-Assisted teleconferencing systems^ in various stages of develop- 
ment.***/ FORUM allows people who may be geographically separated to commu- 
nicate either in real time or on a delayed basis. In addition to its op- 
eration as a conferencing device or questionnaire generation appara-tus, . 
FORUM serves as a limited s torage-and-retrieval system with the various 
conferences as the" data base. The form of all communication withi^FORUM 
is currently limited 'to input from computer terminals although^::j^me experi- 
ments with a parallel voice channel have be^jn conducted. 



*Portions of this report have been published previously in several 
professional articles. Se^, the Bibliography^^ the end of this report for 
specific titles. ^ ^ 

** Joseph E. McGrath and Irwin Altman, Sjpall Group Research, New York: 
Holt, Rinehart & Winston (1966). ' , * 

***SGe Group Cormunication through Computers — Volume \l: Design and Use 
of the FORUM System, Institute for, the Future, Report July 1974. 
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In order to begin with the assumption that FORUM is a "coinmunications > 
medium", we must clarify the meaning of this term. From an engineering 
point ^'^w, a "medium^ ^nvolves only the inherent properties of a par- . 
ticul smission envir%>nment. However, the narrow definition of "medi- 

um" has been extended in most social research to include any system which 
is used for conveying messages among persons. Thus, face-to-face communi- 
cation can be considered a medium of communication, even though the. physi- 
cal medium which is actually being used is the atmosphere, "^his report 
assumes a broad notion of /a communications medium, including the social con- 
ventions associated with fhe transmission environment. « 

The criteria for evaluation of a medium of communication typical.ly in- 
volve comparison with other media. Since the m^ium most familiar to the 
majority of us is face-to-face communication, there is a tendency for this 
to become the standard of judgment. For example, Anna Casey-Stahmer and 
Dean Havron h^ve studied groups of people gathered at communications sta- 
tions and interacting with groups at other stations, comparing -the amount 
of electronic communication between stations with the communication w^th^-n- 
the face-to- face groups at each site.* This approach has offered interest- 
ing data, but it should not lead us to assume that face-to-face communication 
is the "ideal" medium. One needs to exhibit great car^ in such comparisons 
because telecommunications media are not necessarily surrogates for face-to- 
face patterns.' It seems more likely that each medium has its own inh&rent 
characteristics which should hot be expected to mimic face-to-face patterns. 
At the same time, computer-based systems are too often evaluated and ana-^ 
lyzed solely in their own terms. In the case of FORUM, we want to relate 
' observations of ^ the medium to an External standard— one' which can apply to 
many media — as much as feasible. ' 

In turning to the literature of group cqmmunication, however, we do not 
readily discover general principles or procedures which are easily adopted 
as "standard% Instead we find a scattered literature*, oft ea highly special- 
ized, which lacks coordination. Individual researchers (and often "schools" 
of thought) pro3^ide rich information within strikingly narrow frames of 

' V 

*Anna E. Casey-Stahmer and M. Dean Havron, Pla/im/jg in Teleconference 
Systems, Human Sciences Research Institute (November 1973). 
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reference. Also, with respect to social dynamics, these research efforts 
concentrate almost exclusively on faee-to-face communication. Beyond .the 
literature of faqe-to-/ace, g;:oup process research, little ha^ been done to 
apply derived principles of face-to-£ace group communication to other media. 

In 1963, Alex Bavelas offered this summary, appraisal of the relation- 
ship between the research in face-to-face communication and that in elec- 
tronically mediated group communication:^ 



"•..the findings are, in most cases, only remotely related to tele- 
conferencing. The significant contribution ^of this work lies in- 
stead in the methods and techniques of quantitative study^ that hc^ve 
been developed, and in genpral hypotheses abo\*t social process in 
Serins of .which specific propositiorfs relating to teleconferencing 
may be formulated."* . * ' ^ ^^ 

Bavelas went on to say: "It'^pfJears that published information bearing di- 
rectly on teleconferencing is practically nonexistent".** And although much 
relevant research has been done within the last ten years, the^lack of - 
p\iblished material remains as obvious a^ at the time of Bavelas' observation. 

Certa^ly the literature of group process^ is broad and provocative, and 
the potential for relating group process research to communication research 
is real, though complicated by many factors. Alex Reid, while' recognising 
the complexities, offers an optimistic view of 'near-futur~e possibilities: 

"There seems every opportunity for a fruitful transfer of both 
theory and experimental method from social psychology to, tele- 
communications engineering* a transfer that will be particularly 
valuable as the telecommunications system moves away from simple 
one-to-on^ voice communication toward more sophisticated visual 
and multi-person systems."*** 

With this ba<:kground on social research in telecommunication, the de- 
sign of social research performed so far with FORUM can be summarized 
around two sets of questions: ' j 



*Alex Bavelas, Teleconferencing : Background Information, Research Pa- 
per P-106, Institute for Defensf=» Analysis (1963) , p. 4. " / 

**Ibid., p. 12\j 

***Alex Reid, New Directions in Telecommunications Research, a report 
prepared for the Sloan Cozamission on Cable Communications (June 1971) , p* 39. 
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!• What are .the operational characteristics of FORUM as a communica- 
tions medium?^ What are the charactelristic social patterns of 
/ FORUM communication, and how might these be altered? ^ 

^ 2/ What lire the likely social effects of communicatidng via FORUM 
on the individual and on the group? How can-these social ef~ 
' facts be measured? How can FORUM be compared ^to other media? 

^ In designing FORUM research to answer the first set. of questions, fite 
have devised ^a m-^thod for plotting characteristic, social patteAis- and for 
analyzing the , resulting graphs. Saihples of these gra^phs appear in' Chap- 
ter III of this report 'and in Appendix 1. * 

^ In t^ie second set of cjaestions^ the problem of >.cc«iparison with other- 
media has led to a search for a general taxonojvy — that is* * comprehensive 
classification system for r elements of group communication-*which could be 
employed across m^dia in various group communications situations. Such a 
t,axonaiay would frame the most fundtoental questions v^ich must be asked in 
order to assess a particular communication situation involving any group, 
'^Mese questions must apply across media (including face-to-face) , and they 
must be flexible enough to encourage development of a broad range of re- 
search techniques. Some (Components of a preliminary taxonomy are proposed 
in Chapter II of this report - 

The se end set of questions has further lied to the development of a 
variety of measures for evaluating social effects and to the application 
of these measures in field tests. Finally, we have been able to extract 
a set Of hypotheses for continued testing. ' < 

Through the development of the computer conferencing medium and the 
identification of its parameters, we have been able to experiment with a 
tool for interpersonal communication as well as for the stxidy of that com- 
munication. The improvement of interaction among groups of experts is a 
special case of central interest. With a computer-based communications 
tool, it is possible to test a wider set of hypotheses than has been pre- 
viously accessible to researchers who have explored the value of the Delphi 
cind other techniques for the aggregation of group jxidgment. While the pres- 
ent report is but one step toward this improvement, we *hav^ established 
with it a baseline for future efforts. 



18 



7 



(J 



\ 



II. «BSEhBCa APPBOAOI 



ERIC 



19 



II. RESE^H APPROACH 



A, METHODOLOGICAL FOUNDATIONS 

The social *resear'ch which is currently being done by various groups 
studying personal, commxinications medi^ can be divided into three, ^sometimes 
overlapping categories: 

« 

^ " • Laboratory experiments 

• Field tests . 

^ ' • ' I. * - 

• Survey research - . , ^ 

* ^ > ^ , 

A summary of these groups, together with their research styles^ is present;ed 

in Figur'e 2. 

•> * * ■ . • 

1. Laboratory Experiments 

The classic research approach arises out of the traditions of experi- 
mental psychology. The goal here is to control and manipulate certain key. 
eleii\ents (independent variables), while monitoring . the resultant effect on 
other elements (dependent variables) . To minimize the problems in monitor- 
ing the inany variables surrounding a social situation, laboratories are used 
to establish a controllable environment. T^ese laboratories are then de- 
signed in such a way that they replicate (or at least approximate) the "real 
world" . 

In the case of communications research, the problems of control have 
been magnified. In even th^ most "simple" instances of interpersonal com- 
munication# multiple complexities are always present. A ^researcher must at- 
tempt to isplate the effects of a communications medium from the interrelat- 
ed effects of such things as group dynamics, personal attitudes, and topical 
content of the cfbmmuni cation. In a situation such as thisji there is the con 
stant dange^f of simplifying the "real wbrld" to meet the limitations of the 
laboratory. However, a review of ongoing laboratory work is quite rewarding 

*A more detailed analysis of such research is given in Johansen, Miller 
and Vallee, "Group Communication through Electronic Media", Educational 
Technology (August 1974) . Also in: The Delphi Method: Techniques ind Ap- 
plications/ M. Turoff and H. Linstone, eds., Massachusetts: Addison-Wesley 
Publishing Company (in press) . 



» A 



•-12- 



1 , 



MAJOR TYPES ""OF S-TUDY 



ORGANJZATION- 
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Figure 2. Recent Studies by Various Groups Study.ing Communications Media 
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Bell Laboratories, for example, has plfoduced much v^rk in communications 
restearch* '^using variations in experimental methodology. Ongoing work at Bell 
Labs is now concentrating on the behavioral dimensions of two-person, face- 
to-face communication, with an eventual goal being the development of a pro- ^ 
cedure for Comparing and evaluating different media of communication.** 

At The Johhs Hopkins University, Alphonse Chapanis has been doing ^lab- 
oratory research "aimed at discovering principles of human communication * 
that may- b^useful in the design of conversational computers of the future\^*** 
Chapanis has done a series of laboratory experiments comparing audio, hand- 
written, teletypewritten, and face-to-face communication. The tasks were ' • . 
carefrlly selected to be credible "real-world" situations, but the two com- 
municators were always identified as "seeker" and "source". Thus, the ex- 
perimeqts actually used information-seeking and information-giving tasks.**** , 

Another recent set of experiments wMch are relevantv^to research on 
group communication media was performed by Klaus Brockhoff, et al./ at the 
University of Kiel, Germany.***** Using bank .employees as subjects, 
Brockhoff conducted inquiries in the areas of finance, banking, stock quo- 
tations, and foreign trade. Among the independent variables measured for 
effect on group performance were medium (face-to-face Vs. computer), group 
size (in the range 4-H) , organizational structure (open-ended discussion 
vs. Delphi), individual expertise as measured in various ways, and question 
type (forecasting vs. almanac-data). Unfortunately, Brockhoff 's work 



*E.g., Claude E. Shannon and Warren Weaver, The, Mathematical Theory of 
Communications, Urbana,^ Illinois: University of Illinois Rr^ss (1949).' 

**See J. Douglas Carroll and Myron Wish, "Multidimensional Scaiing: 
Models, Methods, and Relevance to Delphi",- in Murray Turoff and Harold 
Linstone, eds. , The Delphi Method: Techniques and Applications (in press), 

***Alphonse Chapanis, "The Communication of Factual Information through. 
Various Channels", Information Storage and Retrieval, Vol. 9, p. 215. 

****The classification of tasks is an essential problem in the research 
of media for group communication. Though no standard typology has yet been 
adopted by the entire field, the Communications Studies Group has developed 
one framework called Description and Classification of Meetings (DACOM) . 

^ *****Klaus Brockhoff, et al.. The Performance of Forecasting Groups in 
Computer Dialog and Face-to-face Discussion, unpublished. 



provides no clearcut findings regarding the independent variable of medium 
(the roost germane to our^work with FORUM) , since it was varied simultaneously 
with organizational structure (i^e.,- the computer medium was used only with 
the Delphi structure, and face-to-face only with open-ended discussion) • ^ 

It should be noted th^at the majority of laboratory e^qperiments involving 
communication processes have »typically concentrated on two-person comraunica- 
tion with cleardy defined tasks, ' Thus, time to solution of the task is often 
a major criterion. Also, sane of the inherent problems of simulating the 
"real world" in a laboratory arise from the lack df continuity in this envi- 
ronment. These factors raise validity questions about "the experimental ap- 
proach, although it certainly has its appealing aspects, including the high 
degree of control and the ability to isolate key factor^, 

2. Field Tests 

In order to clarify the distinction between laLboratory and field tests, 
we should consider briefly the theoretical characteristics qf a guasi 
experiment:' 

"There are many natural social settings in v4iich the research per- 
son can introduce something like experimental design into his 
scheduling of data collection procedures (e^g., the when and to 
whom of measurement) , even though he lacks the full control over 
the scheduling of experimental stimuli (the when and to whom of 
exposure and the ability to randomize exposures) v^ich make a 
true experiment possible. Collectively, such situations can be 
regarded as quasi-experimental designs."* ^ , 

For our purposes here, field tests are defined as explorations of ac^ 
tualf '\real-world** situations wi€h a minimum of experi^nental manipulation.** 
In this sense, they are quasi experiments, though considerations such as 
randomized sampling are usually not involved. Thus, in general terms, some 
of the techniques of the laboratory are applied under less controlled 
circumstances. 

Such a field experiment i^ electronically mediated group communications 
was performed at Carleton University (Ottawa, Canada) under the auspices of 



*Donald T, Campbell and Julian C. Stanley, Hy.perimental and Quasi- 
Experimental Designs for Research, Chicago: Rand McNally (1963), p. 34. 

'^3 / 
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the Department of CcHumuni cat ions, Canada* . Jay Weston and Christian Kris ten 
were ithe principal investigators in this dfL^^ct comparison of three communi- 
pations me^ia (face-to-face, audio, and video), which w^re used as a basic 
part of the pedagogy in a human communications course.** Our research hasr 

y 

i^evealed very few comparable efforts at analysis of group communication 
through alternative media. Thus,' this effort should become an important 
prototype. 

Another example of the field test approach is tha^ applied by the 
British Columbia Telephone Company in th^ir initial tests of the Confravi- 
sion system for video conferencing. This system, given the Same name as * 
'that used by the British Post Office, provides live television links be- 
tween two conference rooms located. in Vancouver and Victoria. Under the 
direction of Anders Skoe, a process for initial field tests was developed 
and implemented before the system was to be made generally available. In 
this way, the British Columbia. Telephone Company group hoped to begin as- 
sessing the behavioraj: impact of the» medium on' the people who would be us- 
ing it. Also, this behavioral goal was linked to initial technical tests 
of the system and longer-range socioeconomic forecasts.** 

An important characteristic o£ field tests is the ability to run them 
over a long period of time. Thus, the credibility of the test improves 
since it is conducted with a sense of continuity and integration^ with every- 
day experiences. One example of such a field test is that being conducted 
by' the New Rural Society Project in Stamford, Connecticut. In this case, 
two banks, located in Stamford and New Haven," are connected via an audio con- 
ferencing system with a studio at each location. The time period for the 
test^ is six months, and a battery of questionnaires has been developed to 
assess both .user expectations of the. system and user reactions at various 
points in time. 

*J. R. Weston, Teleconferencing and Social Negentropy , presented to In- 
ternational Communication Association, Montreal, Quebec (April 1973) , p. 8. 
See also,. J. R. Weston and c, Kristen, Teleconferencing : A Comparison of 
Attitudes, Uncertainty and Interpersonal Atmospheres in^Mediated and Face- 
to-Face Group Interaction, The Social Policy and Programs Branch, Department 
of Communications, Ottawa, Canada (Deceinber 1973). 

**Personal correspondence from Anders Skoe, sociological analyst, Brit- 
ish Columbia Telephone Company, (25 September 1973). 



The field test ap[)ruac^, t 
procedures to the. degree to whx * * 
world. Though the controls are 
amount of systematic data in actual 
field tests can vary from tiuar.x t^x^**;: '^ 
Control over variables, to nu^te o:*',*-^* 

\ 

3. Survey Research ^ 

The basic tools of survey 
In communications research, uni^iuo ; 
of the survey researcher. For rxar.il'L'. 
their needs for media v^ich they hav*- * 
niques of survey research rcnain :vi . i 
be used cjreatively to gather inioi/wi'. , 
dia and speculations about futu^*- rvti,. 

A good example of survey tr. a:.; [ 
a study by Dean Havron and Miko Av» : v 
plan and instrument for a yutv#,»y ^: n**-* - 
for teleconference facilities anJ e 
Averill designed a questionnaire whi v 
conference users, asking then a u t . 
conferencing style and Uu- j^)s.»;.Si 1; * • 

A similar project was direc t:*- : ^ 
focused on existing travel 5<ittt.':n>. *^ 
and Toronto. A questionnaire^ a h-: - 
these cities sought to deterir.ino wti/ 
(rather than use alternative coru-^j:*; \' 
tives. In this case, the overall 



*M. Dean Havron and Mike Avorill, 
of Teleconference Needs Amon^; .ov-^:;;'" : * 
Economic Branch, Department of Cumrr. a\ 
(30 November 1972), p. 1* 

**See James H, Kollen, "Trani;:* : ♦ \' . 
A Research Proposal", Bell Canada \r*^l>i * 



possibilities for substituting electronic communication for travel in inter- 
urban exchanges. 

Dean Havron, with Anna E. Casey-Stahmer, was also .involved in a project 
which used survey techniques to assess existing telecommunications systems.* 
In an effort to establish a general approach to research in teleconferencing 
they developed a grid to classify teleconferencing system dimensions and 
characteristics through information gathered in interviews with actual users 

The techniques of survey research are certainly relevant to the social 
evaluation of communications .media and are frequently OTployed, even in more 
controlled situations such as those mentioned earlier. 

CSG, IDA, and FORUM Research 

In 1970, the Communications Studies Group, which we shall designate 
simply as CSG, was founded in London, England, with direct support from the 
British Civil Service Department and Post Office. CSG has now become a ma- 
jor center of teleconmunications research, building primarily on a labora- 
* 

tory experiments style, but also using nearly all relevant research styles** 
The group has completed more than 75 studies of various aspects of media 
usage, concentrating particularly on the effects which alternative media 
(face-to-face, audio, and audio-plus -video) have on group problem-solving 
effectiveness and user satrisfaction**** 

Among the principal fihdings of CSG is the observation that the choice 
medium affects conference outcome significantly only if the task is one for 

'. • \ ' . 

*Casey-Stahmer and Havron, op. cit. 

**One of the approaches which was pursued eai^ly in the CSG work was that 
of mathematical modeling toward what was called the "Telecommunications User 
Impact Model". These efforts have been postponed now and suggest that the 
present^tate of research involving group communication through electronic 
media is not sufficiently developed to justify the application of mathemati- 
cal modeling techn/ques. Our own experience supports such an appraisal, 
though some efforts (such as those of A. J. Seyler) continue to explore pos- 
sibilities j,n this area. 

***They have also done some media development, the clearest example be- 
ing the Remote Meeting T^ble (RMT) system which is now in operation in 
Great Britain. This system was designed for group audio conferencing, with 
connection between multiple meeting^ rooms, each of which is equipped with 
microphones and speakers around a circular table (CSG Final Report, 1973) . 

♦ - ^/ * 
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v*iich interaction is necessary and personal relationships are re^6vant to 
the outcome (e.g., negotiationor interviewing, but not information exchange 
or problOT-solving) • CSG has also found that acceptability of a new medium 
is* strongly influenced by such factors as location of equipment, the way in. 
vAiich the medium is introduced to new users, the extent to vAiich present ^ 
comrauni cat: ions requirements are satisfied, and the ease of use and reli- 
ability of the new equipment. Acceptability also appears to be dependent 
on task typ^, with all .three media "being acceptable for problem-solving and 
information exchangpa-while only face^to-face (and video to some extent) is 
suitable for meetings involving personal relations or conflict. s:SG has 
gathered sane data on relative costs of alternative media and on probable 
impact on feasible office locations? in this area, the group's tentative 
finding, is- that narrow-band telecommunications (i.e., axidio) offer con- 
siderably Wider possibilities than the much more expensive video systems. 

One other important source of research methodology has contributed to 
the development of our work with FORUM. This is the work of the Institute 
for Defense Analyses (IDA) , which began in the early 1960s. One of the 
first organizations to consider teleconferencing research directly, IDA fo- 
cused on the possible use of such communications media as telephone, tele- 
typewriter, and/or television in international relations. Of special in- 
terest was the potential. for using teleconferencing in crisis -negotiation ^ 
situations. 

Th^ theoretical work done by the IDA is still instructive for research 
design involving g2?oup communication. Figure 3 shows the key elements iden- 
tified in these studies. IDA's approach included simulated crises in lab- 
oratory situations and field tests using different combinations of media. 
This series of studies, which has only recently been released to the general 
public, can be considered a methodological forerunner of the work which is 
described in this report.* 

Building on the methodological foundations provided by these ongoing 
studies, our own work has moved toward a model for field experimentation. 

*Gerald Bailey, Peter Nordlie, and. Frank Sistrxink, Literature Review, 
Field Studies, and Working Papers, Research Paper P-113, Institute for De- 
fense Analyses (October 1963), p. 2. 

37 
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What alternatives 
are aval lable? 




What goes on in 
a conference? 




What makes a good 
teleconference? 


Teleconferencing 


► 


Teleconferencing 




Teleconferenc ing 


arrangements 




processes 




cr i ter ia 



Equipment variables 
Procedural variables 



Structural variables 



Si tuat ional var iabi es 



Interaction variables 

Influence variables 

Informal behavior 

Acceptance behavior ' 

Cul tura I -! i ngu i st i c 
effects 



Decision time 

Accuracy of perception 

Simi lar ity of 
of perception 

Degree of agreement 

Sat isfact ion wTth 
decision 

Knowledge of values 
and expectations 



Figure 3« Typical Predictive ^Sy^item for the Experimental 
^Study of Teleconferencing* 

/ 

*From the IDA teleconferencing studies; Bailey, Nord'l ie, and Sistrunk, op. c 
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crisesr and social determinants), intervening variables (e,gT, interaction 
process), and criterion variables (e,g., group satisfaction and group 
outcome),* . - 

Our initial attenpt to construct a taxonomy has been similar to the IDA 
effort, but has not assumed the crisis ' orientation. Also, our efforts so 
far have not treated the dynamic aspects of the communication, ^ but have con- 
centrated insteat^ on the elements in a communication situation before the 
interpersonal process begins (see lftA*s category "Teleconferencing'%^rrange- 
ments"). Our first, partial taxonomy (shown in Figure 4) ha§ thus been ar- 
ranged to suggest a varied weighting among five key factors, none of which 
will be completely discrete. Fot instance, if members of a given group have 
a- very high need to communicate, they are more likely to make appropriate 
efforts to gain access to any medium, even if i^ is difficult to use or un- 
familiar .to them. Conversely, familiarity with a particular medium is 
' likely to be a very important factor in the choice of that medium for prac- 
tical communication. ^ 

In addition to our own initial taxonomy of preconference factors, we 
eire aware of several other taxonomic efforts which are potentially relevant 
to FORUM. For example, Rudy Bretz has constructed a taxonomy of communica- 
tions media v^ich-he divides into eight classes according to .the coding 
process which is being employed for sending messages \e.q., audio/motion/ 
visual, audio, only, print only, etc.). Having established this taxonomy, 
he then traces the necessary decision points in making a choice of the sim- 
plest medium available to fill a specific instructional need. Using the 
taxonomy suggested in this report, his decision would be based within the 
sections labeled "Medium" and "Task". The dimensions of "Person", "Group", 

and "Rules" are thus not inclluded in the Bretz taxonomy.** 
* 

Another approach to selection of media for instruction was developed 
by C. Edward Cavert.*** His very usable technique operates from a matrix 

f 

. ' ■ / 
' *Bailey, Nordlie, and Sistrunk, op. cit. , p. 14. 

**Rudy^feret2, The Selection of Appropriate Communication Media for In- 
struction: \a Guide for Designers of Air Force Technical Training Programs, 
Report R-60j!-PR, The Rand Corporation (February 1971) , p. JO f f . 

***See Q. Edward Cavert, Procedures for the Design of Mediated Instruct 
tion, State University of Nebraska Project (1972) . ' 
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Physical properties of medium 
Channel capacity - bandwidth 
Symmetry of channel capacity 

(e.g., ]-way, 2-way) 
Commonality of access to medium 
Rel tabi 1 i ty of medium 

(e.g., access, Impairments) 
' Management/control of channel 

Characteristic communication property 
Form of messages (e.g., voice, print) 
Feedback to users 
Management/control of messages 
Time and speed of message handling 
Memory/storage resources 
Access procedures 
Cost 



TASK 



ELEMENTS 

OF 



Divisible vs. unitary ta^s 

(possibility for mutuajrl assistance) 
Maximizing vs. optimizing tasks 

("most vs.: "best") 
Sped f id ty of goa I 
Time constraints 
Need for closure 

Need for particular message form 



l^ULES 



Specificity of rules 
Amount of preplanning for meeting 
Social conventions 
Training procedures - for the use of 
med 1 um 



GROUP 
COHMUNICATION 



PERSON 



GROgp 



Attitudes toward task 
Attitudes toward media 
Attitudes toward group 
Perception of self with 

respect to group 
Personal incentives 

Bl ograph i ca I character is 1 1 cs 
Personality characteristics* 
Social role (in group and 

outside group) 
Phys I ca 1 character I s t Ics 

(e.g., phys lea 1 impa 1 rmen ts) 
Personal communication patterns 

(e.g., nonverbal, skills) 
Access to alternative media 



Size 

General structural properties 
(e.g., role hierarchy, etc.) 

Organ! zational cliniate 

(e.g . , 1 ncent i ves , hos t i 1 1 ty) 

Importance of task 

Reason for group's existence 

Fi nanc ia 1 1 Iml tat ions 

Ease of access to media 

Access to group members via 
med ia 



Figure 4. Identification oT Elements in a Group Communication 
Situation (before Process Actually Begins) 
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showing available media on one axis, with a modification of Bloan's taxon- 
omy of learning on the other axis. (Bloom's taxonomy is a well-known tech- 
nique for classifying types of learning, from rote memorization to ability 
to apply knowledge in new contexts.) Cavert then suggests that each avail- 
able medium be matched to the level of learning for which it seems most ap7 
propriate and that the overall media strategy of a school include a dis- 
tribution of available media across types of learning. Thus, he has de- 
veloped a simpla technique for assessing the general choices of media for 
various needs within some overall design. 

Another basic taxonomy, which differs somewhat in its approach to me- 
dia, is that developed by Fred Lakin.* This taxonomy functions as a cod- 
ing sheet which includes a general format for classification and possible 
exceptions. Though this approach is not yet developed for choice among me- 
dia, it represents a good general format which is quite practical for ini- 
tial classifications of media. 

With such a variety of incomplete, but possibly useful taxonomies, it 
was necessary to attempt a synthesis, with this goal in mind, we sponsoreH 
a small workshop devoted to the clarification of these issues at the Insti- 
tute for the Future in February 1974.** For this group, "taxonomy" meant a 
logical structure through which fundamental elements of^group communication 
could be classified. "Mediuia" assumed a loose definition which included 
face-to-face ccxnmunication. The issues in creating a taxonomy were identi- 
fied 'as: 



*See Fred Lakin, Media for A Working Group Display (available from 
Fred Lakin, 218 Waverley Street^ Palo Alto^ California 94301) . 

**The participants in this workshop were: Garth Jowett, Departifient of 
Communications, Canada; Lee McMahon, Bell Laboratories; Martin Elton, Commu- 
nications Studies Group; Jay Weston, Carleton University; Christian Kristen, 
University of Montreal; Robert Johansen, Richard Miller, and Jacques Vallee, 
Institute for the Future; George Jull and James Craig, Communications Re- 
search Center, Canada; Mike Aver ill. National Film Board of Canada; Tony 
Niskanen, Arthur'D. Little, Inc.; and Dean Havron, Human Sciences Research, 
Inc. The workshop group was kept small in order to promote maximum interac- 
tion and thus did not include- everyone doing key research in this field. 
However, it was hoped that this initial face-to- face workshop would build 
the basis for broader exchange of research approaches and results. 
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• Defining essential elements in a group communication situsction; 

• Determining an appropriate level of abstraction for discussing 
these elements; 

• Fitting^ these elements into a formal structure; 

• Drawing boundaries around Jcey factors; ' 

• Testing the resulting structure on real situations. 

The discussion led to a general. agreement that static frameworks for 
analysis may have been pushed too 'far ^n. existing research. A taxonomy must 
be able to describe a communication situation in fundamental terns, ernd per- 
haps the most fundamental characteristic of communication- is that it goes on 
over time* Thus, descriptors 'of a coitmunication situatipn may be less impor 
tant than the general states of the group before and aftet comraunication oc- 
curs. A viable taxonomy must consider not only the meeting of persons in a 
communication situation, but -the relation of this meeting to larger proc- 
esses. In the past, research has often focused on v^at can be measured, 
though the things which are hardest to^ measure cpuld actually be the most 
important. *' 

^ Figure 5 shows the working taxonomy which the workshop developed. It 
incor.porates the elements of group communication into an overall process of 

' communication through time. Any meeting is itself considered an "episode" . 
in an ongoing communication prqcess. The problem; of course,, is the devel- 
o^xnent of techniques for analyzing., and comparing state Variables after these 
have been identified as important. 

Thi workshop was therefore successful in beginning a dialogue among ac- 
tive research groups and in identifying an overall taxonomy which seems com- 

' patible with differing research philosophies. 

In our future taxonomic efforts, more attention will, of course, have 
to be given to group dynamics. With the exception of experiments involving 
conference telephone,* little consideration has been given to the theoreti- 
cal (i.e., in terms of taxonomy) or behavioral aspects of grOup interaction 

*See Communications Studies Group, Progress in Current Experiment, 
W/71132/CH (1971); Communications Studies Group, Bargaining at Bell Labora- 
tories, E/71270/CH (1971); and Casey-S tahmer and Havron, op. cit. 



-25- 



THE \ 
PHENOHEWON 




COMMUNICATION 
DtVELOP'; IN 
TIME 


\ 




INITIAL STATfc 
fc/PLlClT/lMPLlCiT 
COHf^UNlCATlON TASK 





jaEroRE| "^ 



STATE 






STATE 
VARIABLES 



COGNHIVE SOCIAI 



•STAT^ ' 



STATE OF 

KNOWLEDGE 



PARTICIPANT 




CHAIRMAN 




ORGANIZATION 




SUBORDINATE 




SUPERIOR 




COVERT 

purpose(s) 



KEY CLEMENTS OF THE MEETING 



MODIFIED 
STATE 



NEW 
STATE OF 
UNCERTAl,4Tr 



THIS UIAbRAM REFLECTS THE WALi. L)ISrLAY DEVELOPED AT THE FEBRUARY V, 1374 WORKSHOP 
Tli/DE<5CR1Bl those factors basic to The SOCIAL EVALUATION 0^ GROUP COMMUNICATION 
THROUGH ELECTRCf."!^ ^lEDIA. THE DIAGRAM 5hO*^S ThE DYNAMIC ASPECTS OF GROUP COM^^UNICA-- 
TiUN OVER TIf'E. aE'ilNNI^O AT THE TOP WITH "bEFOPE MEASURES" tSTATE VARIABLES) WHICH 
PREFACE THE A^TTUAL COM«UN I CAT I ON SITUATION. ThESE VARIABLES AftE THEN "FILTERED" 
THHOU^.H THE COyMUMCATION SITUATION 'THE ELEMENTS OF VfHlCH ARE IDENTIFIED IN FIGURE ^ 
AND ARE DISPLAYED HERE ALOSc THE DOTTED LINE), TO PRODUCE SOME MODIFIED STATE VARIABLES. 



\ 



Figure 5. Expansion of Taxonomy in Figure to Incorporate the Dynamic 
Aspects of Group Communication over Time 
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solely by means of a teleconferencing medium. This situation is analogous • 
to the three-body. or n-body problem in phi^sics; a description of two-body 
interactions reveals little about three-bbdy or n-body interactions. Sirfii- 
larly/ little research besides the communic^ion network studies" by Bavelas 
or' Smith and Leavitt has dealt with any of the behavioral or theoretical as- 
pects of the n-body problem of communications. The introduction of "partici- 
pation maps" in the analysis of FORUM conferences represents on6 attempt at 
describing this interaction. 

Future research with computer-assisted media such as FORUM demands in- 
vestigation Qf this n-body problem since the typical scenario includes sev- 
eral users ^ each connected to others by means of a terminal. The peculiar- 
ities of computer conferencing do not allow a facile transfer of theoreti- 
cal or behavioral findings to other media due to differences in (a) time 
and synchronicity of interaction, and (b) the fact that interaction takes 
place through a keyboard. Since it seems evident that the interaction of 
three or more individuals by means of different electronic media is affected 
by the limits andv constraints of technology and hviman engineering, the prob- 
lems of /i-body communications should be a high priority subject for future 
investigation. 

Another technological consideration in studying group interaction via 
eleccrojric" media is "medium memory"; that is, the capability of a medium to 
produce a record of an interaction and to make the record available to the 
user. Information theory and canmuni cation theory have often dealt with 
"channels with memory", but only on a technological/engineering basis. The 
various behavioral aspects of "medium memory" (for example, its presence or 
absence, its availability to users, and the extent of the record) may be 
significant in the use and perception of teleconferencing media; these as- 
pects mii«t be examined in future research. 

C> TYPES OF HYPOTHESES 

Pctrallel to the Institute's taxonomy development effort was an attempt 
to generate and classify hypotheses or statements about network conferencing 
based on current experience with FORUM and knowledge of small-group research 



As part of this effort, a typology of hypotheses was developed in the fol- 
lowing way : ' 

Consider .statements of the fonn: "FORUM has property P'', These may 
be crudely classified in two ways. "Type 1 statements" are stateiaents of 
fact deriving from the implementation of .the system and deiaonstrable in 
physical termc. An example might be: "FORUM enables remote users to ex- 
change alpha-numeric messages."' We use the term "Type 2 statements" for 
those assertions about FORUM that derive from its nature but are only demon- 



strable in social terms. For instance, the statement that "FORUM enables ' 
remote users to engage in joint authorship" may be true physically but false 



Many statements about FORUM, however, fall outside of Types 1 and 2y 
leading to an extension of this classification system. They are of the 



be the statement that "FORUM leads to better recall than face-to-face in- 
teraction". Such statements have been classified as Type 3 statements. 

Finally, some statements, which we have called Type 4 statements, are 
simple assert ipns of facts concerning human or group behavior and can be 
assumed to be medium-independent, although it may be necessary .to test them 
under computer conferencing conditions to prove the point. Example: "Groups 
under stress function better when- strong leadership is present." 

Six researchers at the Institute used the FORUM system itself to pro- 
pose hypotheses to be classified in this fashion in the course of an "Experi- 
•mental Design Conference". Altogether, 267 hypotheses about FORUM were gen- 
erated anonymously in this fashion.* The statements were taken from the 
transcript and transferred onto cards for convenient sorting. The deck of 
cards was then circulated among the staff for a "secret ballot" allocation 
of types to hypotheses. The resulting distribution was the following: 



.^Anonymity as a desirable feature in group communication through compu- 
ters was first introduced in the Delphi context. FORUM supports an anony- 
mous mode through which pcirticipants can make entries into the record with- 
out being identified. I 



in social terms if the system is not perceived as useful by the authors. 



form: "FORUM has property P when com^Jared to medium X". 



An example would 
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Type 1: 3 hypotheses 
2: 83 
-3: 30 
4: 146 

This unconventional approach to hypothesis generation, using FORUM itself to 

stimulate the expression of hypotheses about FORUM, was a canplement to (and 

a release from) the more classical process of theoretical exploration which 

was described in the earlier sections of this chapter. The technique ap^ 

peafed to broaden the scope of Research design. 

After hypotheses, and statements were identitied and categorized, we 

turned to a determination of the experimental mode best suited to each type 

of hypothesis. Given the basic research approaches (laboratory experiments, 

field tests, surveys,, and possibly models), we arranged the types of hypoth- 

> 

eses and the experimental modes as shown in Figure 6. Typ6 1 hypotheses 
can be easily tested in a laboratory environment and do not concern the so- 
cial effects of the medium. Type 2 hypotheses (our focus in the initial 
phase) need to be tested in the context of field tests before specific as- 
pects of the activity can be |)rought into the laboratory; such field tests 
may be quasi experiments, purposive tests, and open*-ended tests. We have 
emphasized purposive and open-ended tests in our research. 

Type 3 J^potheses follow the same pattern as Type 2 to the extent that 
they mainly involve task- and group-related hypotheses. When they involve* 
the medixim as a major variable, a laboratory environment is often necessary* 
Such testing is currently beyond the scope of our. investigations, although 
we have developed an experimental approach to specific hypotheses in this 
domain and may implement it at a later date. 

Type 4 hypotheses will require re-examination in terms of possible as- 
signment in categories 2 and 3, with suitable rephrasing of the conditions 
of the hypothesi^ It can be observed in Figure 6 that some overlap exists 
between. Types 2 and 4. The resulting assignment is often a function of the 
precision with v^ich the premises. of the hypothesis have been stated. 

Given this variety of hypotheses, classifications, and possible designs 
for experiments, the next questions for our investigation were: What factors 

a'7 
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Figure S. Experimental Approaches Corresponding to Four Types of Hypotheses 
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and variables need to be measured? How will they be measured? What statis- 
tics should be obtained fran the computer itself? What new tools can be in- 
troduced to describe and analyze the teleconference transcript? These are 
the questions of measures, and they present unique difficulties in th^ area 
of study . 

D> MEASUREMENT TOOLS 

Measures, which might be used to evaluate FORUM conferences are closely - 
tied to its characteristics as a medium of communication. Though a taxon- 
omy may identify key elements, the weightings among these factors will fre- 
quently be unknown or imprecise. Also, there will frequently be factors ex- 
ternal to the FORl^ conference which are inaccessible to conventional mea- 
surement techniques. Given the mix of relevant variables (e.g., group dy- 
namics, user profile factors, varied purposes for teleconferencing, system 
reliability, etc.), it quickly becomes clear that no single conference will 
reveal all of the fundamental social characteristics of canputer conferencing^ 

A starting point is the identification of the basic characteristics 
of FORUM as a communications medium. Our taxonany of teleconferencing ar- 
rangements has made it clear that PORUM cannot be treated as a clearly de- 
fined, independent variable isolated fran confounding variables. Still, it 
is possible to list some of FORUM' s basic characteristics: 

• CofTununi cation is possible through canputer terminals only. 

• The transcript of proceedings is always available. 

• The \iser can participate in several conferences simultaneously. 

• The medium is self-activated: the user takes the iniative 

to use it at a time when he chooses; delayed and/or real-time 
conferencinq thus becomes possible. 

• Varied group structures are possi^ble', fran open discussion to 
questionnaire./ 

• An unfamiliar social environment is created; exact characteris- 
tics cire uncertain. 
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Given these characteristics^ it is then possible to list measurement 
techniques which could be used as assessment tools. These include user sta- 
tistics, context-related measures, questionnaires, psycholinguistic measures 
user profiles, and other general measures. 

The possibilities for measurement may b^ categorized according to a ma- 
trix which identifies tlie "measurer" (that could be a computer) emd the tar- 
get of the measures (see Figure 7). In this matrix, the "automaton" is a 
FORUM Reporter program which monitors the conference interaction. This mech 
amism -provides accounts of the measures listed under that heading, though it 
does not have access to the content of messages. The human/computer combina 
tion would typically rely upon computer identification of specific types of 
text and human coding of that text. This involves machine monitoring which 
provides specific inform ation, on .line, to a human coder for his/her judg- 
ment (e.g., content analysis of each user input). 

The typology presented in this matrix is directed toward ooiriputer^ized 
conferencing as a single medium. Later applications might also involve com- 
binations of computerized conferencing, audio, and/or visual links. When 
these dimensions are included, the measures shown here will need to be ex- 
panded and the classification modified.. 

We have not attempted to apply all of these measurement techniques to 
the analysis of FORUM conferences. Instead, we have used si)ecific combina- 
tions of approaches. The cmalysis ot FORUM conferences can best be per- 
formed by applying several techniques to the same conference, in this "mul- 
tiple measures" approach. The relationship among the resu!its can then pro- 
vide, useful information on the validity of the overall analysis . 
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HUMAN ANALYSIS 


COMPUTER 


CPU usage/conference 
Connect time/CPU usage 
'Connect time/conference 
Disk access 

Cost In CPU» core, disk/ 

each conferee 
System response time 




User evaluation of system operation 


INDIVIDUAL 1 


1 nputs/conferee 
Errors/conferee 
Commands/conferee 
Editing commands/conferee 
User response times 
Length of comments 
if of private messages 

sent and received 
# of anonymous messages 
Aiiount of connect time/ 

conferee 
Sequence of errors 


Physiological factors during 
FORUM sessions 


Self-evaluation of FORUM sessions 

User evaluation of system operation 

Bales' indices from " 1 nteract ion Process Analysis' 
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Expectations of FORUM 
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Attitude toward task 
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Errors/conference 
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Time between each input 
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Word frequency measures 
Topic classification 
Overall subjective evaluation 



Figure 7. Measurement Tools 
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III. THE ANALYSIS OF COMPUTER CONFERENCES 



OVERVIEW OF RESEARCH PROGRAM ^ 



In the course of this project, we have had the opportunity to observe' 
the behavior of small groups of up to forty participants during the period 
from June 1973 to April 1974. Among the conferences held by these groups ,\ 
ten are of significant interest in the context of our research, either be-i 
cause they were intended for preliminary evaluation of particular hypotheses 
or because their size, duration, or topi<" made them especially relevant to 
our study of computer conferencing in gen. al. It should be noted that al- 
though FORUM has the ability to provide a number of possible structure for 
conferencing,* the conferences in this phase of the research have been rela- 
tively unstructured. That is, structures such as computerized questionnaires 
or votes were not performed by FORUM as part of the conference structure — 
,-^ven though this capability is present. 

For convenience, wq^ have labeled the conferences described in this re- 
port CI through CIO. pf^e basic information about each is listed in Table 1. 

The participants in all conferences became awcire of the availability 
of FORUM either through direct contact with members of the Institute staff 
or by reading articles describing the system. Participation was decided on 
the basis of their interest in using FORUM in the course of their own work. 
Participants were not recruited for the purpose of specific experiments and 
were not p^id. They usually provided their own terminal equipment and^phone 
communications. Only two conferences (C2 and C3) were restricted to the 
staff o^" the FORUM project; two conferences (C9 and CIO) involved no member 
of the FORUM staff • Brief descriptions of each of the ten conferences 
follow: Y 



*See Lipinski, H. m!, and R. H. Miller, ''FORUM: A Computer -Ass is ted 
Communications Medium," Proceedings of the Second International Conference 
on Computcr\:ormunication, Stockholm - (August 1974). 
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No. 


Name 


Act i ve 
Par t ic i pants 


Durat ion 
(days) 


1 

Number of 
; Entries 


Purpose of 
Experiment 


User 
Hours 


CI 


USGS 


9 


30 


13^1 


1 ink to data bases 


NA 


C2 


Staff 
Meet ing 


8 ^ 


122 




effectiveness in 
research management 


81 


C3 


Exper iment 
Des i gn 


7 


125 


517 


effect i veness i n 
research des ign 


64 


Ck 


XYZ 


7 


51 


533 


joint planning 


NA 


C5 


WPO 


' 3 


27 


53 . 


media usage comparison 


26 


C6 


Tradeoff 


29 


22 


1070 


technology assessment 


304 


C7 


Users 1 


31 


120 


399 


distributed software 
testing 


1 

133 


C8 


Users 2 


21 


1 1 1 


551 


joint research 
activity 


89 


C9 


lAWARE 


3 


18 




seminar planning 


NA 


CIO 


AP 




166 


320 


computer science 
research 


279 




1. 


Total:; 


5637 


I 



Tabic Teleconferencing Field Tests Perf ormed w i th FORUM 

(June 1973 to March 197^) . ' 

'•Active participants are those who have made one or more entries in ^the conference. 



Cl^ V*S. geological Survey Conference (June 1973) ^ 

The U*S» Geological Survey Conference was designed to test the feasi- 
bility of linking computer conferencing with large-scale information r'etriev- 
al systems. The working environment was that of the U.S. Geological Survey. 
As the conference utilized FORUM- 3 , (an earlier program version) , no Re- 
porter statistics are available. 

/ 

C2 and\C3. Staff Meeting and Experiiaentral Design {Sxxly 1973 - January, 1974) 

The Institute staff, working on the FORUM project, held a staff meet- 
ing conference over a 'six-month period, with the FORUM medium serving as a ^ 
continuous communication link, eve/! during hours when the Institute offices 
were closed. (Four staff members" each had a home terminal.) A parallel 
conferejice was also created to discuss hypotheses and experiments with 
FORUM. Preliiainary statistical results derived froirv these conferences have 
been reported in Voliame 1 of this report series . 

C4. XYZ' Conference (November-Deceoiber 1973) 

A strategic planning cqnference was held between the Institute for the 
Future and the staff at an organization v^ich we shall refer to as XYZ. The 
goal was to investigate the problc;m of connecting several remote, local 
groups involved in the planning and coordinating of a major public event. 
This conference was one of the first tesrs to deal with a real problem of 
planfiing. 

> 

C5. Washington State Planning Office (November 1973) 

A FORUM conference lasting about thirty days was held between the Wash- 
ington State Planning Office in Olympia, Washington, and a consultant work* 
ing with them in Palp Alto, California. The task was the development of a 
long-range plan for the state, and the conference was used for only one 
month of a project which lasted ^out six months. FORUM was used for peri- 
odic reports by the consultant, for scenario generation, and for general in- 
formation exchange. 
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p6. Travel/Communication Tradeoffs' (January 22 - February 11, 1974) 

Jointly arranged with Bell Canada, this conference was the second gen- 
eration of a discussion among researchers which had been conducted in pre- 
vious years by using conference telephone links ♦ About 35 researchers were 
involved in this FORUM test, all of whom were in some way engaged in work 
related to travel/communication tradeoff s. The subject of the conference » 
was the assessment of telecommunications as a substitute for physical travel. 

C7 and C8. User Reaction Conferences (October 1973 - February 1974) 

These conferences were made available to users who had a specific in- 
terest in expressing their reactions to FORUM, in documenting system errors, 
and in suggesting new featuares. C7 functioned as a tool for continuous 
evaluation while C8 was a general discussion of alternative futures for 
teleconferencing. 

C9. Project AWARE (November 27 - December 13, 1973) N 

When one of the senior staff members at the Institute was recovering 
from surgery, a conference was arranged to continue his direction of Project 
AWARE from his home via FORUM. The conference involved three persons who 
were engaged in planning a seminar, wril|ii^g letters, assigning tasks, and 
generally accomplishing the goals of theirV^o ject during this period when 
normal interaction among them was impossible. ^ 

CIO. Automatic Programming Implementation Notes 

This field test involved a research group at the Information Sciences 
Institute of the University of Southern California. The group used FORUM 
as a collective notepad for communication between task groups and for keep- 
ing records of the evolution of a software development project. 

Of these ten conferences (which are shown in the field test schedule 
in Figure 8), the Travel/Communication Tradeoffs Conference (C6) was the 
most productive from several points of view: it represented the first in- 
stance in which complete monitor statistics (as well as questionnaire data) 
were available. It was also significant in that the proceedings of the 

My 
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* Figure 8. FORUM Field Test Schedule 
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conference were of sufficient interest in themselves , to deserve publication.' 
Hence, what began as an exercise in teleconferencing reached the level of a 
contribution to^'the field of energy substitution. 

Figure 9 summarizes the analysis and measurement techniques that we 
have applied to the ten FORUM conferences. (Each of these techniques is de- 
scribed in the following sections.) In only one case has strict comparison 
been possible with the usage of other media by the participants, namely in 
conference C5. Since the major media used previously by them were the tele- 
phone and travel, records were kept of usage patterns both before and during 
the availability of FOHJM. We found no clpar evidence that FORUM substi- 
tuted for telephone usage or travel in this case. However, the log book re- 
vealed U%at the telephone was used for more interactive tasks, while FORUM 
was used for scenario writing and less urgent exchanges. It is clearly im- 
possible to derive conclusive evidence from this case. 

' Conference C9 provided another interesting test; it was created by ne- 
cessity when the leader of a research group at the Institute was recuperat- 
ing from surgery and had to stay at home for several weeks. A major task 
of the group at this time was to plan and organize a seminar for industrial 
clients on the topic of equality of opportunity. Here the project opera- 
tions were. able to continue via FORUM in a situation in which neither face- 
to-face nor telephone communication would, have been satisfactory. A more 
complete assessment of the user reactions and task performance in this con- 
ference is given in Section III-C. 

Of special relevance in view of the interest in the cost-ef f ectiven/ss 
of computer conferencing is the question of the computer resources utilized 
in conducting a significant conference in a real-world setting. We have 
analyzed the "Tradeoffs" conference from this point of view, examining ter- 
minal connect time, CPU utilization, and storage costs. A good "round num- 
ber" for these costs at the present rates for commercial computer networks 
is about $20 per terminal hour. In Conference C6, there was a total of 304 
terminal hours. This is t\\e most accurate figure available, but it is 


^Proceedings of the 1st International aomputer-Based Conference on 
Travel/Communication Relationships, a limited supply available from Bell 
Canada, Business Planning, 620 Belmont, Room 1105, Montreal 101, Quebec, 
Canada or from the Institute for the Future. 
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Figure 9« Measurement Techniques Applied to FORUM Field Tests 
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somewhat inflated/ sind^e several users left their terminals logged in — even 
wben they were not typing — so they could meet people as they "dropped in". 
If all of the users had been paying commercial rates, we doubt that this 
would have occurred. Thus, we estimate that an accurate adjusted figure 
is about 250 terminal connect hours for actual participation. Multiplying 
this by the summary cost figure of $20 per hour, we get a total computer 
cost of $5,000-i'^- This figure would. not include terminal rentals or telephone 
charges . 

To estimate the cost of a comparable face-to-face meeting is ev:en more 
difficult. If we assume that the meeting might haye beeh held in a central 
location (e.g., Chicago) for a period' of two days, it is possible to cal- 
culate travel and expenses for the participants. Assuming that all 29 per- 
sons vdio made entries in the conference decided bo travel to Chicago for 
the two-day meeting, their total Vound-trip air fare to Chicago would have 
been about $7,000. Figuring expenses (hotel, food, etc.) of $45 per day 
per person, the additional cost would be about $2,600. Meeting place ren- 
tal and arrangements might bring the total to $10,600. This figure does 
not include any costs for recording and transcribing the meeting, a task 
done automatically in a computer-based conference. 

The above analysis certainly has very real limitations. For instance, 
neither figure considers the cost of the participants' time. (Actual time 
spent would have been considerably lower in the computer-based conference.) 
However, assuming the difficulties of comparison, the computer-based con- 
/ ference cost about one-half as much as a face-to-face meeting would have 
cost ($5,000 compared to $9,600) . These figures should serve as a start- 
ing point for more detailed comparisons which we plan to make in our future 
research. 

B. MAJOR STATISTICAL OBSEr.VATIONS 

1. The Role of the FORUM Reporter 

since the beginning of this project, we have envisioned a software "mon- 
itor" which would automatically gather statistics on the interaction within 
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a FORUM conference without threatening its privacy. Beginning with FORUM-5, 
a prototype version of this Reporter has been in operation. It has been 
used in the analysis of all field-test conferences except CI and the early 
parts of C2 and C3. The information gathered by the Reporter is similar to 
that in sociograni analysis, though coders are not needed to observe the in- 
teraction. It is possible to gather data about participation rates, message 
statistics, and a limited number of interpersonal patterns. Since the ac- 
tivity of a computer conference takes place through a machine with statistics- 
gathering abilities, the potential to unobtrusively assess elements of the 
conference (while preserving Its privacy) Is far beyond that of most other, 
media . 

It is useful to describe briefly how the Reporter statistics can be 
used in a specific instance. Later we shall review the major findings from 
all conferences. 

Figure 10 shows the overall growth curve for the C6 conference in terms 
of both public and private messages.* One interesting finding here is that 
there were actually more private messages sent than public messages ^ though 
the growth curves are. not dramatically different. We have no idea of the 
content of private messages not addressed to us, but we might surmise that 
these were us^d for personal concerns and for less formal interchange. It 
is likely, as well, that there may have been more humor in the private 
messages* 

A review of the number of entries per day over the 22 days of the con- 
ference (see Figure 11) clearly reveals the specific days when computer 
failures occurred. On two occasions (February 2 and 7) , the ARPA network 
was down for long periods, and these failures came at, a point when the con- 
ference was becoming quite active. It can be seen that this unfortunate 
timing of ccxnputer failures reached a climax on the last day of the confer- 
ence when pcirticipation approached its highest! point and the network failed 
completely — demanding that the teleconference be ended abruptly. 



♦Public messages are those entered for all participants to see, while 
private messages are seen only by the person (s) to, whom they are addressed. 
For a complete description of interaction modes in* FORUM, see Volume l,'^ 
Appendix 1. 
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The participation rates for each person show that the roles of two of 
the roost active participants are ^ose of group facilitator (Johansen) and 
chairman (Kollen) . The facilitator spent a great deal of time assisting 
people in using the system, as well as ^participating in a substantive role^ 
The chairman was also very concerned abivDut the process of the meeting, 
v^ile still maintaining his key role in substantive proceedings. Thus, the 
two participants with the most messages exchanged were heavily involved in 
the pedagogy of the conference. 

The distributipn of participation in the Travel/Communication Trade- 
offs Conference is reminiscent of the small group participation theory of 
Stephan and Mishler.* In our First Annual Report to the National Science 
Foundation (August 1973), we haye already indicated that preliminary statis- 
^^ics showed participation rates in early FORUM conferences to be similar to 
tl^se predicted £or small face-to-face groups by Stephan and Mishler. This 
ObseVvation is again verified by an analysis of the 12 most active partici- 
pants in the Tradeoffs Conference (Figure 12).** The similarity is based 
on the assertion by Stephan and Mishler that, in small groups, ther^ will 
be a constant ratio of speaking frequencies for adjacently ranked pairs of 
participants; One interpretation of this similarity of participation be- 
tween face-to-face and computer conferencing is that this type of telecon- 
ferencing does not significantly disturb small group participation. While 
our work has not sought to replicate the work of Stephan and Mishler, the 
existence of this parallel is curious, since FORUM is a medium through, 
v4iich everybody can "talk" at once. It is even more surprising to observe 
the same phenomenon for private messages.*** 



*Stephan and Mishler, "The Distribution of Participation in Small 
Groups: An Exponential Approximation", American Sociological Review, 
Vol. 17 (1952), pp. 598-6C^. 

**Only 12 particippiCs?!^ used as a basis for the calculation, since 
their input made up almmyfil'^'of the interaction* Any attempts to actually 
Teplicate the original 'v^^ should obviously provide .much more consistency 
in group size than these tests have provided. 

***It has been suggestec? to us that this observation mi^ht simply be an 
instance of a more general property of group activity, such as the "prin- 
ciple of least effort" described by G. K. Zipf in Human Behavior, Cam- 
bridge: Addison-Wesley (194&) . 
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Figure 12. Distribution of Participation in the Travel/Communication 
Tradeoffs Conference (C6) i 

Note: The curve was calculated according to the formula developed 
by Srephan and Mishler for small groups; points on the graph show 
actual partic pant ranks in Conf'^rence C6 for the 12 most active' 
participants. It should be noted that, in our analysis of each 
conference held so far, the Stephan and Mishler curve did not always 
af>pear; It was, however, very close when a composite curve for 
aP conferences was drawn. Thus, par t icrpat Ion rates seem to vary 
'dlWfks conferences, sometimes resembling the "Stephan and Mishler curve, 
but sometimes being quite different. • c ^ ■ 
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The question of participation rates does, however, raise the issue of 
basic units of participation. For Stephan and Mishler, it was an "utterance"* 
Unfortunately, this unit is not directly equivalent to an utterance in a 
computer conference. The analysis described above has been performed using 
FORUM entrdes as the basic units of analysis. Thus there is some question 
as to the degree to which valid comparisons between FORUM conferences and 
the Stephan and Mishler formula can be made. 



2. Participation Maps 

In searching for a graphic way to capture and display the major param- 
eters of interaction in a computer conference, we have introduced the con- 
cept of a "participation map". This map is a diagram in which one axis 
(abscissa) represents the number of private messages sent by a specific par- 
ticipant while the other axis represents his number of public entries. 

On such a diagram, a participant is represented by a point, but in view 
of the exponential distribution of participation rates (Figure 12) , the "map" 
becomes clt^ar only when logarithmic scales are used on both axes. We can 
next represent each participant as a rectangle, with the horizontal dimen- 
sion proportional to the average length of his private messages and the ver- 
tical dimension proportional to the average length of his public messages. 
On the same diagram, we draw the line with slope 1. Participants to the 
right and below this line tend to be "private" communicators. Those to the 
left and above are "public" communicators* 

. Wo complete the participation map by drawing a representative sample of 
the heaviest exchanges of private messages. 

The overall result of participation mapping is ^a graphic presentation 
of the major conference statistics as they can be obtained from the computer 
alone. Figure 13 shows the participation map for the "Tradeoffs" Confer- 
enco (C6), 
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-51- 



3, General Results 

Appendix 1 includes the growth curves for conferences C2 through CIO 
except for C6 which has already been shown in Figure 10. (Growth curves for 
the public messages have been given in Volurae 1 for the staff meeting and 
experimental design (Figure 10, page 41) and the users' conferences (Fig- 
ure 12, page 53)). Participation maps for the most relevant conferences 
are given in Figures 34-38 of Appendix 

Figure 14 shows the normalized growth curves of public entries for all 
conferences under study. In order to better compare the patterns of growth 
for the individual conferences, each conference has been divided into tenths. 
Each unit on the horizontal axis .represents 'one tenth of the total time 
elapsed for any conference. Standard scores have been calculated for the 
cumulative growth of total messages sent (public + private) in each 
conference. 

When the cumulative growth in standard scores is plotted over tenths of 
conference, three basic patterns of growth can be seen. Figure 14A shows a 
-group of conferences with a fairly constant growth in messages sent. Fig- 
ure 14B shows a group of conferences which have a negatively accelerated 
growth: the number of messages sent early in these conferences is greater 
than that near the end. Participants seem to lose interest in the confer- 
ence or to expend all the information they are going to transmit early in 
the conference. Figure 14C shows a group of conferences which display a 
somewhat positivel:^ accelerated growth: most of the entries are sent near 
the end of the conference in what appears to be a sudden burst of message - , 
sending. 

In general, it seems that overall usage of FORUM, in terms of message 
sending, does not drop off at the* end of the conference period. Six out of 
nine conferences studied here show either a constantly or positively 'ac- 
celerated growth. In the future, it might be useful to examine the social 
characteristics of these conferences '-.tiich would differentiate betvTeen con- 
ferences with different growth patterns. 

Figure 15 shows the Spearman correlation coefficients for the correla- 
tion between pui/lic plus private message-sending. Spearman's mo was cal- 
culated for the number of public entries vs. the number of private entries 

ERIC ^ 




Figure U. Normalized Growth Curves of Public Entries for All Conferences 
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Figure 15. Spearman Rank Correlation Coefficients for Private 

and Public Hessage-Send i ng . (Correlations are generally 
high, although sample sizes make generalization difficult.) 



across the participants in each conference ♦ In general, therQ is a positive 
correlation between public and private message-s ending • Participants who 
make more public entries, in general, make rtore private entries, as re- 
vealed by the four significant correlations found aiid by the fact that all 
coefficients are positive* 

Figure 16 shows the distribution of message lengths and the average 
length for public entries and private entries* Based on nearly 4,000 mes- 
sages, the average lengths were 300 characters for public and 200 charac- 
ters for private messages. Figure 17 shows the length variation of public 
entries at various phases of the computer conference. Initial entries tend 
(on the average) to be longer, perhaps because they often involve prepared 
position statements and self -presentation . Entry length appeairs to stabi- 
lize around 300 characters in the last third of a 'conference.* 

These initial statistical findings certainly suggest directions for fu- 
ture investigation. A summary of these future directions appears in the fi- 
nal chapter of this report. * 

C. REACTIONS OF FORUM USERS 

The reactions of FORUM users to the computer conferencing medium have 
been gathered in several ways, two of the major techniques being interviews 
and questionnaires. In addition, one of the field tests involved the use 
of a log book for comparison of media use. 

1. Interviews 

Interviews have been used quite extensively to date since they provide 
a great deal of flexibility in the gathering of responses. The first se- 
ries of interviews was used with a group at the Information Sciences Insti- 
tute and have been reported in Volume 1. The format was structured around 
several areas of focus, with a series of general questions v^ich the inter- 
viewer could use as probes. These initial interviews were conducted face 
to face, though later interviews were conducted via telephone. Each 



*Note that FORUM itself places no limit on the length of a user's 
statement. 
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interview lasted about twenty minutes and was relatively nondirective. This 
latter point is important since, in some cases, we were not sure of the im- 
portant questions. Thus, we felt that more focused techniques, such as ques 
tionnair^s with precise scales, would have been inappropriate. 

The interview schedule was designed to dir>tinguish between strategy of 
FORUM usage and the particular techniques which were used within the confer- 
ences. The major concentrations' of the strategic inquiry were the group 
characteristics, such as the history of the group, the role relationships, 
and the purposes for the* teleconference. Our interest at the tactical level 
was the actual techniques of usage, as well as the use of other jnedia for 
parallel communication within a user group. 

This style of interviewing was refined for application to later confer- 
ences but kept the same general focus. One addition, begun in the Washing- 
ton State Planning Office test (C5) , was the inclusion of interviews jbefore 
use of FORUM began as well as after. In this way, we began to explore 
expectations and a more detailed notion of the type of group interaction 
before communication through FORUM began. In the case of C5, ccanmunication 
had been ongoing for several months. Again, however, the interviews were 
not used for gathering precise information according to rigid formats. The 
goal was to begin a general process in order to identify areas where scales 
might be appropriate, 

2 . Ques tion nai r e s 

Questionnaires were used cautiously during these early sessions since 
the specific criteria for evaluation were not yet identified. However, as 
specific criteria were recognized, questionnaires were developed and used 
in the analysis of two conferences (C5 and C6) . 

After the Washington Planning Office Conference (C5) , a semantic dif- 
ferential scale was used as one measure of the feelings of users toward 
FORUM as a medium of communication (see Appendix 2) . The scales were 
adapted from the original semantic differentials of Osgood, Suci, and 
Tannenbaum* by Brian Champness of the Communications Studies Group in 



*C. E. Osgood, G» H. Suci, and P. H. Tannenbaum, The Measurement of 
Meaning, Urbana: University of Illinois Press (1957). 
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London.* Tp these scales we added five more which were developed at Bell 
Laboratories in Murray Hill, New Jersey* Existing scales were used to the^ 
maximum degree since one principle of our studies is to compare our work 
with other research wherever possible* Thus, it might become realistic to 
compare attitudes toward FORUM with attitudes toward other media, such as 
audio conferencing or video conferencing. This was only a preliminary at- 
tempt to use the semantic differential, however , so the results are not yet 
complete enough to begin a real data exchange process. 

Another questionnaire with the purpose of a systematic collection of 
overall responses was designed for use with the participants in the Travel/ 
COTununication Tradeoffs Conference (C6) . Since there were about 42 persons 
who had accepted the initial invitation to participate in this conference, 
interviews were difficult to perform. A questionnaire was designed jointly 
with researchers at Bell Canada and Stanford Research Institute. Because 
of time and distance constraints, it was not given the kind of detailed pre-- 
testing that would have been most desirable. However, the final version 
was useful in gathering overall reactions to the conference in a systematic 
fashion. 

The questionnaire was mailed with a printed copy of the complete tran- 
script of the conference. The response rate was very high, with 22 persons 
returning the questionnaire. (Excluding FORUM staff members from the total 
count of invitees, there were 37 in all, meaning the response rate was about 
63 percent, with three additional questionnaires arriving too late to be 
coded.) Of those who did not return questionnaires, only two had made at 
least five entries in the entire conference, so the response rate for ac- 
tive participants was actually higher than it would seeia initially. (Fig- 
ure 18 shows the distribution of participants as a function of their level 
of activity. ) 

The conference participants weirfe first asked to indicate which of the 
other conferees they had known previously. Responses to this question in- 
dicate that the conference renewed contacts among a substantial number of 
• researchers, but that there was also a great number of new meetings (see 

*Brian G. Champness, Attitudes Towards Person-Person Communications 
Media, London: Communications Studies Group, E/72011/CH (1972). 
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Figure 18. Levels of Participation in the Travel/ 
Communication Tradeoffs Conference (C6) 
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Figure 19) • Furthermore, all the respondents indicated that it was likely 
that they would be following up on new contacts rnade during the conference. 
Some follow-ups Were already noted; these varied from requests for reprints 
of articles to invitations to participate in future professional meetings. 
As was mentioned by Paul Gray in the conference proceedings, "With perhaps 
three or four exceptions, everyone who is actively working in this field 
had access to the meeting. This is indeed a remarkable thing; I doubt that 
the early workers in any field have ever had this opportunity before, un- 
less they were working at the same place." 

The overall evaluation of the conference is summarized by responses to 
two questions. First, conferees were asked whether they felt their ideas 
had been presented with some degree of adequacy, even with the various net- 
work problems (Figure 20) . The second question probed the degree to which 
each conferee' s important reasons for participating in the conference had 
been satisfied. The responses to this question (see Figure 21) were again 
generally positive/ with half of the respondents indicating that they were 
satisfied. 

Thus, there is evidence that this conference served to connect an "in- 
visible college" of researchers who had not been completely connected be- 
fore, and that the overall reaction to the conference was positive. How- 
ever, the evidence of significant numbers" of previous contacts does raise 
'the question of v^ether the confeien^e was primarily the renewal of an "in- 
group" of the research ccxmaunity. 

The questionnaire results offer only indirect insight at this point. 
If the conference were simply a renewal of an old in -group, one might ex- 
pect satisfaction with the conference to show some relationship to the num- 
ber of people who were known previously. Figure 22 shows, however, that 
there is no clear association between satisfaction and number of previous 
contacts. It is interesting that even persons who knew only a few partici- 
pant's before the conference were sometimes very pleased with the results, 
while those who did have previous contacts were sonetimes disappointed. 

The questionnaires also documented some of the frustrations which were 
experienced in the conference, particularly in regard to computer failures 
on the ARPA network where FORUM was mounted. These failures nearly canceled 
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the beneficial effects of the conference. All of the - participants experi- 
enced them to some degree, 1 

The frustration with network reliability was complicated by the prob- 
lems which participants exjgt^rienced in getting access to computer terminals 
at their own research sites. Together, these problems multiplied uncomfort- 
able feelings about the medium, since many had never used a terminal device 
before. Frequently, participants had to go to other places to get access 
to a terminal. Some of these problems are expressed in questionnaire 
comments : 

\ 

"Very strong hindrance as I had to use terminal on someone's desk 
and walk about 300 yards to get there, going outside in rain to 
do so. Poor access was my most severe problem." 

"The only time I had available was after working hours during 
which time the building with the terminal was closed," 

"A terminal at home might have increased my participation. if 
I had had to travel to a terminal, I would probably have made 
the same sort of contribution as those who came on once and 
nqver again. Having it in my office allowed me to participate 
overy day (if we could get on the system) ," 

"I could leave the machine Oi vhile doing other things without 
disturbing myself or others. I would then check at intervals 
if anything had been said." 

The last two comments reveal that having easy access to* a terminal (e.g. 
at hone or in the office) made a great difference in the degree of partici- 
pation. All of those who were heavy participants had easy access to a mod- 
ern computer terminal, and several even left the terminal/ logged into the 
conference for extended times (several hours) to meet pejDple as they "dropped 
in". The terminal itsel'f is obviously an important variable in the overall 
success of a computer conference. The inconsistency of different terminal 
devices and the inaccessibility of them to ^nany people are major obstacles 
to the successful operation of this kind of teleconference. 

Other questionnaire comments noted the problems of structuring a cum- 
'puter conference around a broad subject area $uch as the assessment of tele- 
communications technology as a travel S'lbstatute. There was no initial fo- 
cus beyond this subject definition, and the substantive dialogue was fre- 
quently interrupted by questions about computer c</nf erencing . Although an 
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agenda was agreed upon and followed with some degree of allegiance, the fre- 
quent threads back to earlier sub^jects (a general characteristic of computer 
conf^erlnces) were disconcerting to some of the participants. Suggestions 
were made during the conference and on the questionnaire that specific 
follow-up conferences might be held with smaller groups and more focused 
topics. Based on the experience of this conference, such suggestions seem 
worthy of serious consideration. * 

Since computer conferencing involves communication only through type- 
writer keyboards, an interesting area of inquiry is the process of "meeting" 
people in this fashion. The personal experiences in this regard varied 
greatly but may offer some insight into human implications. The following 
reactions illustrate the diversity of responses: 

"I found FORUM a very different medium froQi FT? [face-to-face] con- 
ferencing. Because response time was long and medium 'cooll-, it of- 
fers opportunity for all participants to think about what was just 
said before they respond. In FTF it is often the case that one 
must respond immediately to v^at is said for fear of seeming rude 
or inattentive. Because of this you tend to hear some rather mean- 
ingless comments in FTF that the speaker would probably not make 
if he had to type them out." 

"My comments were generally fairly formal, although, toward the end, 
some did encourage some less formal contact which helped social con- 
tact between us but probably distracted others. The private mes- 
sage function was used for chatty little comments more frequently — 
the inclusion of these in any analysis would give a different pic- 
ture of the formality of the process." 

"Relationships were established easily, personalities came across, 
conversations could and can be established this way, and that's 
partly why I'm now a believer." 

"I was surprised to find that 'effective* relationships can be de- 
veloped over the system. The tijne zone problem was somewhat inhibi- 
tive of ease of access; this also was true because of terminal/net- 
work problems — especially in the UK^'." 

"I feel such kind of dialog with people you haven't met is usually 
too sterile and tends toward unnecessary formality." 

"This offered people who would never meet the chance to interact 
on a semipersonal basis. Time differences: i.e., persons in the 
evening in the UK interacting with others in bed with a portable 
terminal m California early a.m. Computer conferencing also helps 
get around time differences in the asynchronous mode." 
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'*Can*t communicate as freely over teletype as in person 

"I found It difficult to organize my thoughts and type gramma ti- 
cally* When committing thoughts to paper there -is usually a much 
greater opportunity to correct and amend the text." 

"Actually, expressing my ideas by typing with FORUM was not the 
problem I suspected it might be. In fact, typing allows one to 
give more consideration and focus to what one- is saying." 

Though we have not yet begun to make extepsive use of questionnaires, 
we are optimistic about the use of standard groups of questions to compare 
research results involving different media. Since the face-to-face work- 
shop which we organized in. Menlo Park to consider questions of social re- 
search with teleconferencing systems, we have been pursuing the 'idea of ac- 
tive exchange of research results. A FORUM conference on this topic, with 
the CcHRmuni cations Studies Group, Bell Laboratories, and Institute for the 
Future as the principal participants, iias attempted to create a canmon ques 
tionnaire for use by CSG and the Institute. This questionnaire will ini- 
tially allow direct com^aris,on between FORUM and the Remote Meeting Table, 
an audio conferencing system developed by CSG. We hope that this exchange 
will grow irr^K a kind of "pool" of questions from which other researchers- 
-can draw. The results will then, at sane point, provide a basis for inter- 
national and intermedia comparison. 

3. Log Books 

During the Washington Planning Office Conference, (C5) , the conferees 
were asked to use a log book to record each tim'e a communication was made 
using a medium other than FORUM. The log book had small pages laid out in 
the following format: 

What medium used? 

Te 1 ephone Mai 1 T r ave 1 Othe r_ 

To whom? (including copies) 
Why this medium? 

Date and time? (Both time of day and duration of communication) 
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The conferees were asked to answer this set of questions each time they 
chose another medium. The purpose of this method was to explore the reasons 
that other media were used, and conversely, that FORUM was not used for cer- 
tain types of communication ♦ When used together with other measures (e.g., 
records of phone calls made, letters exchanged, etc*), the log provides a 
more open-ended method for registering feelings about choices among avail- 
able media. Attempts can then be made to derive characteristic reasons for 
using (or not using) a particular medium of communication. 

The major disadvantage of the log book is its obtrusiveness . It takes 
a real degree of commitment on the part of conferees to record each choice 
of medium, and undoubtedly, some of these will go unrecorded. (Some check 
on the frequency of use can be done by comparison with actual usage statis- 
tics for other media, however.) Thus, the log book provides useful informa- 
tion only if th'e conferees can be assumed to have a rather high decree of 
commitment to it. 

4. Subjective Analysis of Task Performance 

In Conference C9, the Project AWARE discussion, a special study of the 
text has been made; here we observed a high number of daily entries compared 
to 'the other conferences studied jln this report. The entries themselves 
fall into the following categories: 

• Questions and instructions on how to use FORUM 

• Work instructions and assignments ^ 

• Exchange of topic-related information 

• Planning of activities ^ 

• Decision-making 

• Editing of texts of letters and brochures 

• Personal interactions, greetings, and comments 

Most of the entries were much shorter than the entries in any of the other 
conferences and would often consist of only one word or one line. There 
were many more personal comments and much less formality. Private messages 
were used infrequently, since with only three participants, the conference 
provided an atmosphere of i)rivacy. 
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In assessing the results of this FORUM conference, we looked at two as- 
pects: first, the tasks the group was able to perform and, second, the per- 
sonal satisfaction with the medium. 

In relation to a forthcoming seminar, the group drew up the agenda, dis 
cussed participants and roles, and planned letters, brochures, and materials 
to be sent. FORUM was also used to decide the location for the seminar. 
Various options were suggested and investigated, and the staff discussed 
what was needed, from physical requirements to "tone" to price. They chose 
a place and then followed through with the actual arrangements. 

,In terms of project research, strategies were decided, research was re- 
ported and discussed, and persons were assigned to or took specific tasks. 
Along with all these items, the group planned and coordinated its everyday 
activities . 

C9 was thus not simply a discussion conference: operational decisions 
were made, action taken, and project activities continued. To that extent, 
the group carried on its regular work using FORUM for communication. This 
observation should be qualified by noting that there was some communication 
in addition to FORUM, There was one face-to-face njpeting, principally de- 
voted to editing text materials for the seminar. One person occasionally 
delivered papers at home to the group leader, and there were a few tele- 
phone calls (but very few, said one staff member, who commented that using 

f 

the phone much of the time would have been unsatisfactory because of the 
necessity of taking notes and the ease of forgetting information) , 

The second aspect considered in assessing this conference was the re- 
action of the participants to using FORUM to communicate. Each partici- 
pant's opinion was obtained through interviews and discussion. From these 
opinions we may conclude that the use of FORUM in the asynchronous mode was 
extremely convenient. .The group leader, for example, could enter messages 
at any time practical for him, and these messages would always be waiting 
for those at the other end, jWhen people are in and out of their offices, 
' any specific phone call may not be able to reach them, while FORUM is al- 
ways open for sending and receiving. An inspection of the transcript sug- 
gests further that it would have been difficult to handle the large number 
of entries via the telephone, requiring, as many did, consideration, dia- 
logue, or outside checking of information. The use of FORUM also forced 
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the group to organize its work and its canmunication more carefully. Mem- 
bers found that the medium required them to be precise in their questions, 
answers/ and instructions to each other. In addition, the written record 
provided an easy way to answer any question of what was said by any person. 

However, one person commented that writing does not convey the nuances 
found in facial expression or vocal inflections, so that feelings, emphasis, 
and interpretations could get lost in the ccmmunication. For this reason, 
it was sometimes difficult to get a sense of priorities from the written 
messages. 

All agreed that the review feature of FORUM was useful. This feature 
enabled one reseeircher, who was in and out of the office during the time 
period of the conference, to obtain, on his return, all the entries ad- 
dressed to him, provided they included his name in the text. "Review" also 
enabled another person interviewed to pull out all the items on a particu- 
lar company or subject to learn what had been done or discussed on some 
topic (she estimated that she used this feature ten to twelve times) . 

The medium was unwieldy for discussing the drafts of letters and texts. 
When ideas had to be "batted eiround" and thoughts were not yet specific, or 
when many alternative formulations were to be considered, the time taken up 
was considerable; this process was thus inefficient and frustrating. 

The work and personality characteristics were clearly related to the 
feeling of satisfaction which the participants expressed. The group leader, 
who was constrained to be at heme and intermittently up and down (he was 
recuperating from back surgery) , was pleased with how it enabled him to con- 
tinue his direction of the project. Another researcher, who worked full 
time on the project and spent the most time in the office with the terminal, 
liked the medium and its use. The staff member who had divided work respon- 
sibilities (so that he was out of the office frequently) and who is atten- 
tive to facial expression, gestures, and tone of voice in communication, 
found it less efficient for his project work. 

In summary, project operations could be continued via FORUM in 
a two-week situation in which neither telephone nor face-to-face communica- 
tion would have been satisfactory. The FORUM conference had advantages 
even beyond the usual project communication, including the written record. 



7H 



-71- 



precision of statement , and enforced organization^ On the other hand, it 
seemed less efficient for drafting and revising textual materials and for 
communicating messages such as values which normally come through non- 
verbal communication^ 

D> CX^T ENT ANALYSIS 

— ' y 

^* Content Categories >/ 

Since the transcript is an injierent part of FORUM communication, the 
possibilities for content analy^^ig are quite promising. Our first explora- 
tion of these possibilities occurred during the first year of our work in 
this project, with an early version of FORUM. In that situation, we estab- 
lished three basic categories for messages: problem-solving , information 
exchange, and general discussion. Each message was also classified as 
either dyadic or group- oriented, in terms of the direction of the state- 
ment. In these prelimincury inyestigations, we noted that the early por- 
tions of a conference were frequently dominated by "information exchange" 
comments, usually involving learning about the system. Later in the con- 
ference,^ more "problem-solving" entries occurred, as the substantive pur- 
pose became the focus of attention. Though both dyadic and group-oriented 
comments occurred, no clear pattern was suggested. 

These exploratory techniques were used to gain preliminary information 
about the length of time necessary for various persons to become comfortable 
with FORUM and to explore different ways of introducing the system to users. 
The trend toward problem-solving shows the movement from initial quick ex- 
changes (usually about the operation of the system) to more substantive dis- 
cussions of the problem area preassigned as a topic. The data on group ver- 
sus dyadic orientation was useful before the private message feature was 
introduced and as a way of identifying significant subgroups within the 
conference. 

In the analysis of the Travel/Communication Tradeoffs Conference (06) , 
James H. Kollen at Bell Canada developed a series of content categories 
that are more specific than those mentioned above. The frequency of each 
category can be plotted over time to show th^ evolution of the conference 

• %7 
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roore specifically. Also, the social dynamics of the conference can be sum- 
marized and analyzed with some precision (see Table 3) . A major problem 
which arises here, as with participation rates, is the definition of a ba- 
sic unit of communication. Each FORUM message is determined by a particu- 
S^lar conferee and may actually contain several different content categories 
within it. Thus, the content categories should not necessarily be struc- 
tured around the discrete FORUM entries. 

The problems in performing analysis by content categories mean that the 
coding process is always long and tedious and that the results are typically 
not available until long after the conference has concluded. Many of these 
problems could be alleviated if a method for doing content analysis via com- 
puter could be developed. 

M 

2. Topic and Interactive Thread Analysis 

Apiother kind of content analysis involves the tracing of specific themes 
as they evolve over the course of a conference. Though our experience is 
still limited and the procedures cure not standardized, the method has a u/2i- 
que relevance to communication through computers. One of ^the basic patterns 
of computer conferencing is the tendency for "threads" or "chains" to occur 
during the conference.* These threads are particular topi|;s which are in- 
troduced but not necessarily fully discussed in a consecutive series of com- 
ments. In fact, there may be long interludes between comments on a certain 
topic. Or in the case of a conference in which several people are involved 
simultaneously, it is often possible to discuss several topics at once, with 
a series of threads connecting the comments. {The thread may be facilitated 
directly by saying "re. Comment 13", or. it could be^ tied more implicitly to 
an earlier idea, as in "re. the summer workshop...".) 

Given the existence of these topic threads, it is then possible to 
trace them over time. Such a process reveals key points in the life of a 
topic thread: the introduction of a new idea, the continuation of the idea, 

*An GxampleVf a FORUM discussion with multiple threads has been given 
in Volume 1, ppr^ 56-58. f 

so 
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OBJECT-RELATED 
MESSAGES 
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(158,260 char.) 
















REGULATORY 
MESSAGES 




EQUIVOCATION OR' 
IRRELEVANT 
MESSAGES 


]8% 




\7% 


(it5,230 char.) 




(kO,k75 char.) 



.Table 3* Content Categories of All Messages in Conference C6 
As Developed by James H. Kollen of the Business 
^ Planning Group at Bell Canada. 
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and the synthesis or climax of the idea. Of course, there are also ideas 
which are introduced, but from which a topic thread never grows. 

When topic threads are then identified with^\^e participant who ex- 
pressed them, it is possible to see a pattern of roles developing. In some 
cases, for instance, particular persons tend to introduce many new ideas, 
while others function as idea-developers > and still others as synthesizers 
of previously developed ideas. These roles could vary greatly among per- 
sons and conferences. Thus, by examining the overall patterns for a FORUM 
conference, one can see both key persons (roles) anji key ideas* 

This section describes an initial attonpt to perform such an analysis 
on part of a FORUM transcript. The transcript is from the XYZ conference 
(C4) , which took place during November/December 197 3. The basic unit of 
analysis was the FORUM "entry", a paragraph of input text labeled hy FORUM 
as to its sequence number, author, and date and time of origin. Yx\ Confer- 
ence C4, 388 public entries were coded ^equivalent to 47 pages of. single- 
spaced text) . 

Seven individuals participated in the conf erence^^hree (It whom were 
Institute for the Future personnel. As we shall see, there was consider- 
able difference among the patterns of participants' contributions (see 
Table 4). Even more important is the great disparity in the number of 
various participants' contributions (see Table 5) . 

Turning now to the main analytical contribution, we shall examine the 
logical sequences of substantively interrelated entries in the conference. 
For brevity, each such sequence will be referred to as a "chain". Each 
chain is defined as the downstream flow of entries clearly following from 
one "new-idea" entry, and the lat+-^r, in turn, as an entry for which no 
obvious and direct inspiration by a preceding lentry is discernible. Of 
course, such definitions leave much to the judgment of the coder, but many 
items contained explicit cross references such as "re. 207". In our estima- 
tion, intercoder reliability would be very high, no more than a very few 
percent of the necessary coding decisions being at all doubtful. 

The analysis of C4, then, consisted of a close reading of the confer- 
ence transcript, identification of the precursors, if any, of the substance 
of each entry, and recording of the observed linkages in a format similar 
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to that of Figure 23. (The resulting flow-chart was a six-foot vertical 
scroll.) The transcript was further analyzed according to a variety of cri- 
texia. Any entry which headed a chain was, by definition, a "new idea" en- 
tr^. An entry at. which two pro-existing chains converged (e.g., entry 5 in 
Figure 23) was deemed a "synthetic" entry. One from which two or more sub- 
chairts diverged was defined as a ** provocative" entry. And finally, any en- 
try at which a chain terminated was judged a "dud", since no one saw fit to 
respond to it'. ^ 

As might be expected, the average number of entries in a chain in- 
creases with the number of participants who contribute to that ch^in. It is 
a less obvious finding that the average number of entries per participant is 
highest for chains to^v^bich either relatively few or relatively many partici- ^ 
pants contribute. A pos^'lble explanation for this (borne out by examination 
of the content ot the chains in question) is that chains with few contribu- 
tors tend to be closely knit mono- or dialogues with few abrupt (chain- 
terminating) changes of subject^ v^ereas chains with many contributors tend 
to be unusually important ones on which everyone has not , only something but, 
in fact, /a great deal to say. 

The following relations may be taken as tentative conclusions of our 
topic thread analysis and perhaps as candidate hypotheses for subsequent 
replicative s1:udy. 

• The number of new ideas which a participant contributes' correlates 
significantly with both the number and frequency of provocative ' 
ideas which he contributes. ' 

• The frequency with which a participant contributes ne\f ideas has a \ 
significant negative correlation with his freque;*icy of synthetic \ 
ideas. 

Together, these two propositions suggest that at least two mutually exclusivje 
types of conference participants are discernible (influenced perhaps by role 
perceptions)* One type Strives ^ to advance the conference by introducing sub- 
stantive material which is either new or of such importance that several 
others may be inspired to y^spond. The other type strives to facilitate the 
cr r "^nce by gathering up loose strands and bringing the discussion back to 
its prescribed theme. 
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Figure. 23* Hypothetical Sequence of Entries, 
Showing Chains 1-3-5-6-7-8-9 and 
2-^-5-6-7-8-9 



new idea, (^^^^~ regular entry 
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-A second approach to thread analysis of conference transcripts was de- 
veloped by Gwen Edwards of Stanford Research Institute, parallel with the 
work of James H. Kollen, mentioned earlier. Rather than concentrating on 
topic threads over time, Edwards obseirved interactive patterns, ^'igure 24 
shows the categories which she established, with the basic distinction be- 
ing between person-directed and group-directed comments. By following the 
threads of these comments over tiirie, she was ^le to see the kind of com- 
ments th^t-prompted the longest interaction and the type of interaction 
which occurred. The basis for this analysis is "type of interaction" though 
,it uses the content categories developed by Kollen, 

3. Semantic Analysis 

One of the most important concerns about FORUM, as already described In 
Section III-C (Reactions of FORUM Users), is the loss of those nonlinguis- 
tic coumuni cat ions which accompany face-to-face meetings. FORUM conferences 
are entirely in the written mode; there are no paralinguis tic vocal cues — 
such as pitch, intonation, pauses, or stress — nor are there physical pres- 
ence cues such as facial expression, posture, or movement. In face-to-face 
communication, some of these cues are very important in regulating the inter- 
action and flow- of the discussion. Others are used in communicating rrfes^ 
sages of emotional feelings and attitudes toward other participants. In 
FORUM,., some of these messages do get translated into written fona — "This ter- 
minal is ugly!" or "Let/s move on to the next toj^ic." However, th^re is a 
distinct narrowing of what is transmitted, an^-^any motional, interpersonal 
messages disappear. It may be, of course, that such messages are not always 
necessary to discussion. But when the only context for "meeting" a person 
is an impersonal keyboard and an equally impersonal terminal printout, tbe 
personalities of the users might seem inaccessible. 

With this concern an mmd, we have explored an approach which has 
proven rewarding in analyzing FORUM transcripts to se^ how much para linguis- 
tic and nonlmguistic comm^ilnication may be translated into the written mode. 
(;ur approach involves a careful study of the use, order, and frequency of 
words within the context of a conference environment and is based on earlier 
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contributions from Pittenger, Hockett, and Daheny* and from Edwin Schneidman. 
The former have used microscopic interview analysis to successfully infer, 
from an analysis of the first five minutes of a tape-recorded psychiatric 
session, the basic psychiatric problems of the patient. Schneidman has used 
logical content analysis to infer certain aspects of an individual's cogni- 
tive styles from an inspection of written or spoken text. Finally, Laffal's* 
method of word association analysis, which often reveals implicit levels of 
meaning in a transcript, has also provided a basis for our approach. 

a. Technique 

This approach involves three key assumptions: First, a generalization 
and basic principle is that everything communicated is meaningful; i*e.f 
all aspects of the transcript are to be considered. Second, meaning and 
pattern in communication are culturally based and then mediated by the in- 
dividual person, the communication situation (e.g., the medium, the task), 
and the others in the situation. Third, communication may be about the 
topic, but it is also about the communicators themselves, about the situa- 
tion, and about any immediate concern. Furthermore, a list of the possible 
subjects to v^ich participants are likely to respond or refer in any conunu- 
nication would include: 

The topic of the discussion, usually overtly 

• Ordering or structure messages 

y m Feelings and emotions regarding the individual himself, the topic, 
the discussion or the process of communication, and another 
participant 



*R. E. Pittinger, C. F. flockett, and J. J. Daheny, The First Five Min- 
utes: A Sample of t^icroscopic Interview Analysis, Ithaca, New York: Paul 
Martineau (I960). See also Arthur Hastings, "The First Five Minutes: A 
Review and Discussion," ETC: A Review of General Semantics (December 1964). 

**Edwin S. Schneidman, The Logics of Communication : A Manual for Anal- 
ysis, China Lake, California: U.S. Naval Ordnance Test Station (1966). 

*** Julius Laffal, Pathological and Normal Language, New York: Atherton 
Press (1965). Also: "Contextual Similarities as a Basis for Inference," 
in George Gerbner, et. al.. The Analysis of Communication Content, New 
York: John Wiley (1969) . 
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• Personal relationships (e.g., roles) or group relations 

• Intentions 

• References to a covert topic 

These may occur in questions, answers, information, offers, emotional re- 
sponses, and many other forms. The subjects are not necessarily overt and 
a part of the surface li^e of the written text; indeed, the first t'Wo are 
usually the surface content, and the others occur more implicitly in choices 
of words, sequencing, and other linguistic subsystems. Our analysis has 
sought to uncover such communications. 

In applying this technique to FORUM transcripts, it is important to 
note the characteristics of the FORUM system. The author of an entry has 
the option of editing or rewriting his contribution to any extent he de- 
sires before it is entered into the transcript; ^e may alter a misspelling, 
rewrite the entire entry, prepare it in advance'^ or even cancel it. Thus, 
we are not necessarily reading a spontaneous comment. Instead, there may 
be several layers of revision based on the writer's wish to clarify, add 
evidence, impress himself, ijnpress others, protect himself, or take into 
account the reactions of other participants. Editing also occurs in face- 
to-face communication, but it is internal. We do not know v^ether there 
would be more or less editing in writing compared with speaking or whether 
the individual is consistent in the amount of editing he does regardless of 
the mode or the context. (Data relevant to editing activity in FORUM-6 
will be obtained by having the system keep track of the use of editing func- 
tions which could then be correlated with individuals, types of conferences, 
and the purposes of the discussion.) 

Also, because FORUM conferences are usually circumscribed in subject 
matter, there is pressure on the participants to stick to the topic, whether 
It bo the design of experiments, the use of teleconferencing systems, or ^he 
ongoincj operations of the group. Depending on the number of participants, 
their acquamtanqe with each other, and the public nature of the conference, 
the amount of ix^rsonal and non- topic messages will be affected. In an open, 
many-participant, sub;3ect-laboled conference, there will likely be con- 
straints pressing towards formality, logical consistency, and lack of emo- 
tionally toned messages. 
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One other factor will affect the content of the transcripts: the phys- 
ical requirements of the system itself* A computer terminal is slightly 
different from a typewriter in arrangement of some keys, in the touch re- 
quired, and in the time delay of the printing* These factors all require 
some adjustment on the part of the user, and until he feels comfortable, 
he IS likely to be self conscious and perhaps hesitant in his entries. In 
the same manner, if typing itself is slow or if there is self-consciousness 
regarding it, then we would expect: entries to be more selective, less fre- 
quent, and also shorter, and so not necessarily reflective of the total re- 
actions of the participant. 

These qualifications all point to areas in which we must make assump- 
tions about factors which affect the communication process in teleconfer- 
encing via FORUM. There is almost no research (hard or soft) on these is- 
sues, and for that reason, we have to rely on heuristic assumptions drawn 
from our present store of experience with FORUM and other media of commu- 
nication. In sumraary, these are: 

1. Teleconferencing provides fewer channels of ca:nmunication than 
face-to-face communication does and requires that messages be 
coded into written or printed symbols. 

> 

2. The canitted channels are typically concerned with regulating 
ongoing interaction and communicating feelings, intentions, 
and personal relationships. 

3. However, messages of the type mentioned in #2 are implicit in 
the written channel to some extent, overtly and covertly, and 
may be brought out through various techniques of analysis. 

4. The point of analysis is the submitted entry, after editing 
(if any)*'^y the participant, 

5. Private messages are assumed to be relevant to the public con- 
ference, and where available should be correlated with the main 
discussion.* 

b» Initial unf amiliarity with the system will affect the number 
and lengths of a participant's entries, but there is a gradi- 
ent of learning v^ich leads to a level of relative ease for 
most persons. 



\ 
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b. A Sample Transcript Analysis 

The following is one analysis of the first 20 entries in a FORUM con- 
ference on the potential use of FORUM in coordinating the planning of a pub- 
lic event. The entries in the transcript are printed first, and the analy- 
sis of each entry follows in italics. There are four ^Participants who will 
be indicated by their initials: JV and RJ at the Institute for the Future, 
and E2 and PB at the XYZ office. RJ and EZ had met each other in person 
once previously, arxd JV and EZ had talked with each other via telephone. 

[1] Z WED 7-NOV-73 3:33PH 

Z here, but I guess that^s obvious. Thanks for letting me join. Pm 
giving a deno of the system to P on our staff. P recently joined from 
...[the] federal government organization through which we obtain the 
computer service... P is the real technical wizard at the detail level 
on the... [net], and I can be counted upon to provide broad brush info, 
background info, and philosophy of the system. I haven't explained 
what-all we've talked about on subject, but in the meantime, feel free 
to direct any questions to either of us. 

Initial need to identify self in addition to machine identification, 
"But" indicate^ self-conscious realization of this and slight em- 
barrassment. 

Awareness of being "let into the group/' and thanking for that 
action. 

Definition of presence of PB; definition of PB's role and status. 

Implicit request for interaction with PB; wants IFTF to impress 
PB. 

The "X" instead of "he" is either ambiguity re PB's role, or an 
intended direction of the sentence which was changed in midstream 
to stay with PB. 

Explicit request fQr including PB, but not clear yet how to do it. 

[2] V (CHRMN) WED 7-N0V-73 3:33PM 
Hi, E. Where are you right now? 

Initial greeting. First name used creates warmth; sets tone of 
conference formality* 

System does not indicate location, so question as^s , perhaps to 
help visualize the participants. 
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Question also asks "What is your state of mind; what are you think- 
ing about?'* 

[3] Z WED 7-NOV-73 3:38PM . 

In our office at... [street names} in Washington 

Z answers the overt question; note three levels of detail: office, 
address', city. 

[k] \l (CHRMN) WED 7-NOV-73 3:39PM 

RA and RJ are here in the office. Why don*t we pursue our phone discus- 
sion in more detail? 

V indicates presence of two others; no definition of role or sta- 
tus (Z knows RJ already) . 

Implicit definition of situation: demonstration? 

V makes agenda suggestion, (Z needs stronger guidance than this.) 
Not clear if RA and RJ know about the phone talk. 

[5] Z WED 7-NOV-73 3:A0PM 

Fine. P has some ideas. It might be useful for him to get on line. P, 
in addition to the other IDs we discussed earlier today, why don't you 
establish an ID for future, so they can get started. Yesterday I gave 
them a contact in SFO to get manuals, which they will have tomorrow. In 
the meantime they've made contac t . , .and they* re gonna have their own ac- 
count. Hy first thoughts are to give them access to our system:; to sup- 
port the effort to implement FORUM on [the net] thru B account, with 
FORUM guys doing the Implementation, with our help — technical guidance. 

Agrees to subject. 

Further attempt to include PB; obvious concern. 
Talking to PB on FORVll so others "overhear." 

Anibljuous discussion, since it ds to PB and not to IFTF partici- 
pants , 

Defining roles botwecn IFTF and them, but not to IFTF, This is 
not for IFTF reply yet, 

TMs may be answer to double level of V's question in 
[6] Z WED 7-m\J'7i 3:khm 

J, we would appreciate your sending us ahy documentation you have on the 
system, so we can begin pondering the technical difficulties. One thing 
that St; ikes me right off the bat is that though the full-duplex capa- 
hi lily ib exciting and efficient, it Is confusing [to] the user. And, 
th^it capability doesn't happen to be available on the .! .system. 
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Z responds to V's first name greeting. 
■No reference to phone conversation; still caught up in own concerns. 
Specific action request.- 

Statement r^"full duplex capability" in a^"yes, but" type, in 
which "confusing" has more weight than "exciting" . Also a per- 
sodal .reference, i.e., "It is confusing tome." 

Inference is'^that 2 ^sti^:fngly dislikes being confused. 

Implication is ttiat Z would like to omit the full duplex capabil- 
ity, but it is not clear how much weight that preference should 
' be given* 

[71 Z WED 7-NOV-73 3:^6PM 

P, the gentlenen I've talked to so far are RJ , a .sociologist and a re- 
search associate at the Institute for thfe Future. Also have talked 
to HL and JV, who would be responsible for the implementation under^^ 
discussion. / 

Third ei^txy in a row bxj^Z* No waiting! 

Z introduces people at IFTF; does he do this because V did not? 

Z i/s still not feeling in touch with IFTF and who is there* 

You would' expect this kind of introduction to be told PB off line; 
since it is on line, we can infer Z considers it an important as- 
pect for beginning a discussion* 

JV is mentioned as an "afterthought" and RA is omitted* Z needs 
information on th&m. 

[8] V (CHRMN) WED 7-NOV-73 3:^7PM 

I have some familiarity with data-base systems on-1 ine' on. • . [the net] 
What is the most practical high level language I can use down there that 
has good interface with file system? 

V tries another type of question* This is also an initial re- 
sponse to PB and the technical aspect introduced by Z* 

Also may be asking .\ "What language can we use with each other?*' 

Gives some information about his knowledge background* 

This does not respond to Z's request in #6. 
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[9] Z *WED 7-NOV-73 3:WPM 

f^ORTRAN is excekUnt. COBOL is also good, and P likes it (I don't care 
for it so much). The command language and a combination of COBOL, 
FORTRAN, and/or DML (Data Mahagement Language), will work. All these 
languages can be easily mixed, under control of the command language. 
Within programs, FORTRAN, GOBOL,, and the Assembly Language (and the com- 
mand language itself), can be freely mixed as subroutines and/or 
overlays. 

Immediate quick response to question with much ^ata. 

Note negative association to PB. This is wore h^alancad, and sug- 
gests that initial high level of concern is dropiping* 

[10] Z WED 7-NOV-73 3:51PM \ 
Say, could you include B in the conference, please?, ^ 

\^ * 

Request for PB to be included independently , rather than as a part 
of Z's channel* . \ 

Means both ''talk to him" and "give him participant status'*. 

This is quite different* in style—note the three ameliorative, ap- 
peal words: say, could , and please. 

\ 

III] V (CHRMN) WED 7"NOV-73 '3:52PM ^\ 
Re, including B: will do. ^ ' 

'\ 

V responds immediately , clear and definite* \ 

\ 

[12] Z WED 7-NOV-73 3:53PM \ 
f\cM can I get the participants status reports in the middle of a confer- 
/ence call, assuming I lost the status report given at thepeginrwng of 
the session? Also, does the system tell me when someone ite entering? 

Again, here we\^ee concern for being in contact with tj^ho is on and 
/ what is happeni^* ^ \ 

The first question he has asked on the immediate situakiion in proc- 
ess, though in the form of a query about the system. \ 

[13] Z WED 7-NOV-73 3:55PM 
Great! 12 just answered. Thanks. 

The system respoSi^ and answers his question by its act^Lon, IrSdjcat 
ing that RJ is joining! I 

[]k] 1 WED l-\m-ll 3:55PM I 
Further to 9. In a separate. . .subsystem is the BASIC capabiljity. BA- 
SIC can get to any of the files created by the. . .subsystem (tjhe one 
hosting COBOL, FORTRAN, etc.), but because it's in a different subsys- 
tem, you can't mix BASIC with the other languages. 

" < 
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Continues answering V'*s question in #9. Need to giv^ full amount 
of information. ' 

[15] Z WED 3:57PM 

Wow! What a helluva tool! More on 8, 9, and \k\ B..*Is a combination of 
command language, FORTRAN and DHL. The control language is used to 
initiate the session and to provide certain error traps. FORTRAN sets 
up all operations (features) and actually does several. DML does all 
the updating and querying. 

The anxiety of the introductions is lowered^ and he takes stock of 
FORUM with a release of positive energy. 

Completes his ;pun out of information re V's question* 

I16] J . WED 7-NOV-73 3:57PM 

You will know when someone new enters, E, as you should just have seen 
as I joined. Hel lo. 

/ 

RJ's first entry. Picks up Z's personal concern and relates to 
that as his initial self identification . 

Uses first name greeting . 

I17] B WED 7-NOV-73 ^:OOPM 

We have a real need for a powerful assistant such^ as this to enable us 
to ffl,1 our mandated function to coordinate the ^projects and events.... 

PB's first entry* 

Compliments FORUM. Sajys it relates to their ne^sZ. 

, Evokes authority of ^y^rnment and via the mandated their own.' 

Formal vo,cabulary ^ and style. Can't be replied to directly; is 
more an anriouncejnent. 

Refers to specific events and gives agenda or topic cues. 

1 [18] Z WED 7-NOV-73 j^:01PM - / - ^ 

Have you established any protocols for usage? For instance^, i"^ seems . 

n better to terminate one message addr^essed to an individual, starting a 
new one for the next person one wants rtp address", rather than address,- 
ing several people in one message. Comment? * ^ , . 

i 

Z is concerned with reducing confusion in the flow of tlie dis- 
cussion. ' 

question on methods of organization. * 4 
Concern about reducing confusion in the flow. , 



Question on how to handle the discussion in ,this medium*- What 
rules or customs help? < Openness. 



[19] V (CHRMN) WED 7-NOV-73 ^:02PM ' " 

What do you see as the major conference topics among the different 
cerjters? 

I • ' Responds to and reinforces ^agenda cues in HI?. 

? Probably realizes that strong guidance is necessary* 

* '1 ' ' 

B can respond, butyls not required to, since the addressee is not 

specified. ; f, 



[20]' V (CHRMN)' WED 7-N0\/-73 .^*:03PM 
We tend to observe 1 various "styles" of conferencing in the synchronous 
mode (^s we are^now doiog). • For instance we^ oVten find'ourselves hav- 
ing, two or three discussion streams ^going at .the same time, and it re- 
mains quite cdbnfortabte. We begin many ^rt^ssages wj t'h "Re topic, etc." 

.V responls^ to the- question in, Hid by saying indirectly that several 
things can be done at once so long as their refer^ces are clear. 

Z's question- is not answered' directly ; his nee^for order may not 
jbe satisfied* 



' Commentary on the analysis. It should be evident that this method of 
analysis provide^ a, great deal of infonnat\on about the participants, their 
interactions with each o^er, and th|ir attitudes and feelings about the 
top-Tcs discussec?. 'suclvSftformation is in addition to the overt semantic con 



tent. Howeve'r, in assessing this information, we must observe several cau- 



tions : 



1. Because the interpretations are inferences, not truths, they , 
have varying degrees oC probability .\ Idea'^fe.y, they should be 
confii^lned (or disconf irmed) by the si:ibject himself,, as far as 
possible. 

•■ ■ > 

2. It is difficult to assess the weight any one item should carry. 
Validity comes through repetition of themes and consistencies 
.which can be observed best in longer transcripts. 

3. Characteristics and meanings are relevant to the immediate situ- 
ation; with other participants and other topics, different pat- 

'terns would likely emerge. 
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Given such cautions, even with this brief 26-entry transcript, wc can 
note patterns regarding participants, theij: communication, and the struc- 
ture of the. discuss ion; In a sense,' it is at this point that traditional 
forms of content analysis come intso%)lay, being used not for the original 
transcript, but to tabulate th^ occurrence of themes in the analysis. 

Themes of the conference* A tabulation of the themes which have emerged 
and their treatment inclvfdes these : 

THEME ^ STATUS ^ ^ 

Location of participants Completed^ 

PB Cc«npleted ' - 

Roles of participants Completed ^ 

Telephone "^conversation Left hanging * . » 

IFTF and XYZ relationshij| " 'Not picked up ' ' ^ 

.System features ' Continuing ^ 

Language, for"' interface ^, Question answered I " 

Coordination of events Continuing / 

Protocols for communication Continuing 



Differences bei^een written and spdken discussion. If it were ^ssi- 
ble to hold the same conference twice, once on FORUM and once face to face, 
and then analyze both sessions, we;. would have good comparative data on the 
differences between communication in the tswo media. Failing that, we will 
draw som^r conclusions on differences between faofe-to-f ace discussion and 
FORiIJm teleconferencing based on this tjranscript' in comparison with observa- 
tional experience of. various face-to-face conferences. These observations' 
could be tested^^re prWisely by using discussions on similar topics with 
the same persons or balanced' groups , so that- task and individual differ- 
ences will be minimized and the effect of. the media can be seen more 
'clearly. ' * * . . * 

1. The increased infonrtation available. in face-to-face communication, 
because of 'the increased .aural ^nd visual channels, results in 

an increased number of messages in the d;LSCussion. 

' \ ' ' • . 

2. In face-to-face conferencing, there* is a greater variance in 
the length of comments; i.e., there are more long contributions 
and more short contributions than in teleconferencing "^fia 
FORUM, in v^ich entries tend to cluster around an average. In 



ERLC 



-92- 



FORUM^ ^here is a, tendency to ' avoid overlong entries or at 
least to breaJj long entries ^into segments. At the same time^ 
there seems to be a tendency to make each entry count and to 
say more^ than just a few words. Thus the length of FORUM en- 
tries tends to be more uniform. 

3. In face-tp-face disctission^ there are mpre questions asked of 
/ participants than in FORUM conferencing ^ although it is not 

evident in the transcript here /which has seven questions in 
twenty entries* This larg.e number ofcurs in the opening of 
the disc^sion and serves to orient the participants, and fa- 
^ cilitate interaction. Later, in^^e conference the questions 
diminish considerably. This is not the case in face-to-face 
conferences. 

4. Interruptions are .more frequent in face-to-face discussion. Of 
course, they are impossible in FORUM conferencing because of 
the nature of the program. But further, they are a part of the 
flow of face-to-face conferences and are an obvious ^difference 
in the dynamics of the' situation. . ^ • 



5. jTher^ ar^ some further impressions on differences between writ^ 
^ ten and .'ispoken discussion which are less certain at this point . 
of corfparison, but which could investiga^ted : f \^ 

a. Topics range more broadly in face-to-face discussion than in 
FORUM teleconferencing. 

' • b. • It easier to get off th^ track in face-to-face,, conferences . 

c^. ' There is a higher proportion of implicit decisioVis in face- 
r' ^ to-face conferences; in FORUM, they are maSk expUgit. 

V. d. There is more interactive adjustment of ideas, frairtewotks, ■ 

and communic^ation Ityles among .participants in face-to-fade 

conferences^ than in FORUM conferencing (or the adjustment 
^ - occurs at a faster rate) . * ' 1 

These methods !of content a»a]fysis— %val^u^tion of content categories, 
topic thread Walysi^, and semantic analysis— are still embryonic. However 
they provide a starting point for more exhaustive' qualitative evaluation.: of 
the effec^is ol" FORUM on" group communication. 



;0 



4 



IV. CONCLUSION 



A. MAJOR FINDINGS 

The most useful results of our research to date have been in develop- 
ing a sophisticated computer conferencing medium;^ in gathering user behavior 
data and a body of observations drawn from user experience; and in defining-, 
viable research approaches based on an initial taxonomy of conmiuni cations 
media. We are also prepared to offer some preliminary findings about the so^ 
cial effects of FORUM. This section of the report thus* summarizes our cur- 
rent knowledge about the use of computer conferencing. 

An appropriate- starting point is an analysis of th^ factors we have 
found to affect the use of FORUM. These factors can be summarized accord- 
ing to the following categories: ^ 

1. PhysicaT Conditions. t 

af^ Thresiiold of familiarity and skills 
If ^' ^Characteristics of the iiel^minal , 
^ C. J Access to the termijial and phone' link ' ^ 

» d. State of the ccxnputer and network 

2. Persoi^ Attitudes and Social Needs 

a. , Feeling of obligation to use FORUM 

b. Desire tq be "in touch" ^ 

c. Work and life style 

' * ■ 

Need to communicate information relating to rol-^ ^ 

3» General Social Conditions 



a < 

c . 
d. 



S 

Physical separation * 

\' 

Responses to questions 

Need for infoirttiation or understanding 

Group task and structure 'y 
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1, Physical Conditions . . . , ^ ^ 

a. Threshold of Skills 

For conputer conferencing to be used with ease, the system m^t becone 
"transparent"; that is^ the physical and mental attention needed for 'using, 
the system must diminish so that the person can attend to communication it- 
self. Initially, there is unfamiliar ity with the terminal, the written mode, . 
and the lack of physical presence of others, as well as other distractions. 
If the user continues to cohmunicate frequently <ifn the system, some of these 
unfamiliarities recede^ and he learns to use it more or less automatically. 
We have gbserved that if someone uses FORUM only intermittently, however, 
his skills may not be practiced enough to give him familiarity; for many per- 
sons, tl-iis lack of familiarity will decrease their entries or inhibit their 
participation. * 

Typing skills also seem to affecj^a person's participation, though we 
dJ not yet have experimental^^iat^t-^n this poiat. One staff member observed 
lat when a person's typing is slow or uncertain, he becomes more selective 

v^at He answers or when he -writes because it is a greater effort, and un- 
- # 

t^t that initial threshold is passed, there is reduced participation in the 

conference. * ^ . 

This fact might be altered if a participant has a , second person do the 

typing for him, but this procedure presents some problems of its own, in-*- 

eluding delayed responses and removal of the communicat9r by one step from 

the medium.* ♦ • 

f * 

b/ Characteristics of the Terminal 

* . Some terminals are easier to use « than others, and each has varying de- 
grees of' reliability ; these aspects will affect the willingness of a person 
to be* involved in a conference. Hard copy is. essential foj^some needs (e.g., 
the need for a printed record for teference). But CRT terminals can also 
bel^sirable for s*peed, "ease of editing silent ojperal^ion, anc^ the absfnae i| 
of unnecessary p^>^ scrolls. ^ * ^ . ^ 
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• *An example, of a participantf doing the tirpin^ for another ijias been- 
given in 'Voliine. J. of Gi.oup ■Casmanica.tion throagh Computers, Report R-32, 
pp.. 47-51. ^ . • ■•' 



c. 'Access to the Terminals and Phone Links 

In order to participate in a conference, the user needs a terminal and 
a phone lijik to the canputer. Phone links are available in major cities,- 
but terminals usually have to be taken with the traveler since they are not 
yet in general use in business, industry, and government; We have experi- 
mented withi the Texas Instruments portable terminals that weigh about 37 
pounds and with an E^eq^port model that weighs 27 pounds; they are both 
heavy -to lug around airports, through Customs, and to professional meetings • 
This problena is likely to remain until terminals become more portable dnd 
more available. • O ' 

State of the Computer and the Network 

The state of the conputer influences conferencing in two ways. Firrt,* 

when the network is loaded heavily, the time lag^^ (response time) may b^ 

high, so that -^h^sy St em takes a long time to transmit messages^ and even 

to type the participant's message on his own terminal as he writes it. 

(This last characteristic is due to the fact that the system uses "full du-^ 

plex", which requixe^ that th6 typing go to the computer and be accepted be- 

« ^ */ 

fore it types out on the user's bwn* terminal. ) The lag, of course, 'is 

- % ' ^ <^ 

frustrating and often confusing, since rapid feedback is usually expected 

for: satisfactory communication. 

However, this " frustration is minimal compared to that which occurs when 
the system crashes, the computer "stops", and the terminal prints out a mes- 
sage such as "HOST NOT RESPONDING" ! In normal usage of computers for data 
^compiling or statistic^al analysis, a computer failure is annoying. But when 
it happens in the middle of a real-time conference among several people, 
deali^ig with intellectual and emotion-charged matters, the effect is devas- 
tating: each person is i|fc>lated in midstream. 

At present, this factor of networlj; unreliability is a major technical 
problem which faces teleconferencing. Since most of the Institute confer- 
ences h^ve been in the asynchronous (delayed) mo^e, computer crashes have 
not seriously hampered participation. However, in synchronous discussion, • 
such a^ demons tratioris , it has occasionally been necessary to change to a 
second ,c5omputer vfhen the first Qne ."crashed". For more continuous use of 
management and conference operations, the program would best bemused with a 
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computer whose load is stabilized at a "below-crash" level and whose user 
h 

, interface is properly designed with gdod attention to human factors. 

The unreliability of the network we have used for development** and the 
difficulty' in obtaining a sufficient number of guaranteed "ports" (tele- 
phone line access points) into a computer have been the limiting factors in 

I - ' 

ouf ability to experiment with synchronous (simultaneous) conferencing. 



2. Personal Attitudes and Individual/Need's 

a. Obligktion to Use FORUM [ 
'One of the basic important factors is simply how much the individual 

feels bbligated to use FORUM in contrast to communicating in some other/ 
mode or not communicating at all. This is -particularly true in a situation 
in which face-to-face, telephone, or memo communication is feasible, Jt 
takes effort to use computer conferencing, and^if it i^ easier to cotamuni- 
cate information in some other way, ,then the individual's own motivation ^ 
will be the determining factor. In our own Staff Meeting transcript, there^ 
are some evident instances' of obligation use, as when one staff member 
noted that the log of project activities was not being kept up (presumably 
as it should have been ke^t up) , and another staff member made several con- ^ 
tributions after a request for more entries. The staff had agreed earlier 
in the project to use the conference every day, *but the transcript shows 
that this commi^jment was not being carried out. There was some sense of 
obligation, but this did not seem sufficient to maintain a continuous in- 
put from everyone. 

b. The Desire To Be "In Touch" 



Most pei^ons have some need to comratiiTrcate with others, and some have 
strong desires to do so. Of the participants, some desired a high level 
of communication with the rest; while others foij/f^ this unnecessary* Of ^ ^ 
course, if the desire for communication is satisf ied>'by - face~to-fdce or 
telephone. meetings in the physical context of the off-ice, it vfould not be 
expressed in FORUM telecorif erenaing unless the individuals wei:^ separated, 
such as they raig[ht be if working at home or. if away on pro ject matters . 
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c.> Work Style and Life Style 

Teleconferencing fits well into the lifestyles of some people — they can 
do their job, make reports, and talk .with colleagues wherever they are, re- 
gardless of .the time.^--Xhey can work at home as well as at an office, and 
they can work at^their own pace^ and time, which may be different from the 
standard 8:00 to 5:00 office job. For them, teleconferencing is a compati- 
ble and even liberating tool, and they are likely to use PoRUM to ^enable 
them to get into a preferred mode of working and living^ ^ 

One participant's comment was, for example, that he liked FC^UM be- 
, cause he could work at home without time pressure, without interruption 
("which would cause me to lose my train of thougigt").> and at his own pacd 
on creative ideas and thpughts. The results couj-d be viewed by others at 
their leisure, at their own rate of work. ' * 

^ On the other hand, some people prefer a scheduled, set work time and 
work space. Rather than finding it confining (as the first group is likely 
to do), they uSe it to fo^cus jtheir-work attention and separate their job 
from the rest of ^their life. These people are likely- to use FORUM within 
the time and space they assign to their work, but not outside those 
boundaries, ' 

Within the Staff Meeting conference; we have seen a tendency for the 
staff members to make ^ntries at other times and fran other places than the 
•office and the "working hour^" . All of the staff, at one tijue or another, 
made entries after 5:00 ^.m. Many of these were' from their homes. (The to- 
tal| proper tion'pf entries away from the office* was 63 percent, broken down 
as:^^35 percent while traveling and 28 percent while working at home out- 
side offj.ce hours". See Volume 1, page'42 for detailed' statistics . ) 

Of course, one would har.dly conclude that the FORUM staff is already 
moving into a new lifestyle with the help of teleconferencing. The travel- ^ 
ing was, to some extent, , dictated by the responsibility of the staff member 
rather than being a^part of his lifestyle. The reporting from the destina- 
tion, however ^' was a deliberate innovation and a part of the work style 
made possible by computer conferencing. 

For most of this period, the members of the staff had tenninals at 
their homes as well as at work, ^ but also were under some constraints to 
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appear at the offices of-sthe Institute for the Future every, day (e.g., be- 
cause of expectations fran other employees o£^ the Institute) • So to som^ 
extent, any entries in the Staff Meeting conference which were made on their 
"off* hours were above and beyond ^the calljof duty, rather than siinply work 
on. the project* 

One of the major problems in considering social attitudes toward work 
styles is the language which is available for conceptualizing the situation. 
Notice these oppositions, which can be seen as "either/or" categories, but 
which often ^e not: 

job leisure . • 

work ' — play 

working hours off hours, non-working hours 

Anyone who has worked at any job realizes the unreal categories created 
by the social definitions of these words. ! Accordingly, efforts to change 
work styles through teleconferencing will ]^ncounter the social attitudes * 
whlph assume that these categories are rea|I . "Work" has came to mean "8:00 
to 5:00 in the office" and also the operations of the job. The two meanings 
have become equated, collapsed- into eacli otheiS| so that the implications 
are: (a) what one does from 8:00 to 5:00 in the office is work, even if it 
includes coffee breaks, and (b) what one does out of the office is not "work 
even if it is some operation essential to the job. 

The assumptions about the uses and definitions of these terms are ar- 
bitrary, but are held unconsciously. Thus, if a person makes entries in a 
computer conference after "working hours", it may tend to be dismissed or 
classed as "extra"; and if a person , stays at home during working hours and 
doe^ his job via FORUM, he may be viewed as not doing his work. 

FORUM teleconferencing , 'as used in the Staff Meeting conference , would 
enable the members of this project (and many other groups) to h^ve a work 

style which Includes carrying out responsibilities away from an office or, 

I 

which Is more varied In terms of time* If this should happen, we could ex- 
pect problems to arise related to criteria for the definition of work and 

for determining when one is doing work and v^en one is not. In addition, 

p 

we could expect that there would be individual personal problems of main- 
taining work attention in contexts associated with "non-working" activities. 



And people who prefer to structure their work activity throug^^ the use of 
time and space might also face new problems. 

This aspect of FORUM has not been fully tested by the staff use of ' 
FORUM during this period; therefore, few conclusions can be drawn as to the 
use of computer conferencing by persons with alternative work styles or the 
effect of FORUM on those styles. 

d. Afeeof to Communicate Information Relating to Ro le 

> In our ongoing Staff Meeting conference, it became generally evident 
that each person participates most in the area of discussion "(or particular 
conference) which is most related to his perceived role. Indeed, Figure 25 
shows the ^'participation track" of four institute staff members in confer- 

S i 

ences with different topics. Participation rates are seen to vary widely, 
and no individual appears as "typically private" or "typically public" in 
all conferences. ^Role requirements can* be recognized. This is hardly a 
surprising finding, and we expect to be able to generalize it for future 
FORUM conferences. Furthermore, since FORUM is a new medium for most peo- 
ple, it may be desirable to use established social r^oles to ease introduc- 
tory periods and increase participation. However, one of the potential 
valwes of FORUM conferencing is to bridge role separation, and this aspect 
should also be kept in mind when planning a computer conference. 

3. General Social Conditions 

a. Physical Separation \ 

The function of physical separation in motivating staff meeting entries 
has already been discussed. When Institute staff members were away on trips, 
they tended to make a large number of entries reporting their activities. 
This fact reflects both the physical separation, which excludes face-to-face 
communication, and also the increased intensity of the person's activities. 
A further advantage undoubtedly occurs because the "report" of the trip is 
made quickly, in written form, and is available to all, eliminating the ne- 
cessity of a formal presentation or a multitude of explanations to 
individuals. 



♦ 
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AVERAGE MESSAGE LENGTH 
I I 500. 

500 characters 




NUMBER OF PRIVATE MESSAGES 



Figure 25., Participation of Four Users in Conferences Dealing with Different 
Topics. A circle has been drawn around the participant serving as conference 
facilitator. (J7 represents the participati<^ of Johansen in con/erence C7» 
M3 shows the participation of Miller-inX3» etc. V designates Vallee and L 
des ignates Lipinski 
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b* Response s to Questions . 
: M 

Often, when par tif;ipa ting in a FORUM conference, one may simply watch 
the transcript and, even though interested, make no entries. However, a 
specific or direct question almost always gets an answer from a participant. 
This pattern occurs not only because a question has social protocol requir- 
i^-£L-§a answer,, but also because a question can specify what kind of answer 
is required in terms of subject, point of view, and th^- ^. u. Thus^, 

it facilitates any interchange. 

c. .Veed for Information or Understanding 

The reverse of the preceding observation is that when a person needs 
information, he is more likely to make entries. These may be in the form 
of questions, as above, or they may discuss topics in an attempt to clarify 
or organize an idea. 

The last two activities are evident in the various user reaction con- 
ferences. Questions, information-seeking, answers, and discussion comprise 
a high proportion of the entries in those conferences, and their power to ^ 
compel participation is evident. 



dj. Group Task and Structure 

Very unstructured tasks and groups will have difficulty adapting to 
communication via caaputer conferencing as' represented by FORUM. A major 
factor hero is unfamiliar ity with a new medium, but there seems to be more 
to this observation than the learning process. In the Travel/Conmunication 
Tradeoffs Conference, for instance, the topic of discussion was not pre- 
structured witn any more specificity than the title suggests. There was a 
general reeling among the participants, registered both in the transcript 
and in the post-conference questionnaire, that a more focused topic would 
liave been more productive. This criticism was especially important in this 
conference, since it was the first meeting for many of the researchers. In- 
deed, wo have now proposed to experiment with prolonged conferences on 
highly structured topics. 

It is also possible that there is an optimal threshold of structure in 
a computer conference. Our finding at this point is that completaly v 

) 

* . - i 
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•unstructured canfer.ences are frequently unproductive. However, it may be 
that an increase in structure wil\L only be valuable to a certain threshold, 
beyond which it will not be perceived as positive. 

Oi ts have identified many elements of group communication 

througl .ompa:er conferencing and have offered some initial conclusions on 
actual usage — based on about 3,000 terminal hours of actual conferencing , 
The communication potential of FORUM grows out of its easily available writ 
ten record, its ability to transcend time and^space limitations , and its 
encouragement of organizatirn. While these characteristics are not all- 
inclusive , they offer unusual resources for group communication. This re- 
port has only began to summarize and evaluate these potential resources, 

/ 

B. FUTURE^ DIRECTIONS ' 

Based on the Institute's substantive experience with FORUM, it is pos- 
sible to project several areas for future research. Specif ically / we have 
been able to generate a broad range of propositions to serve as general hy- 
potheses for further testing. These are listed in Table 7. In our judg- 
ment, most of these propositions are probably true. We do not, however, 
presume to glassify them according to their importance — relative either to 
one another or to the universe of propositions rec^arding other aspects of 
teleconferencing. We present them, instead, as samples of hypothetical 
statements worthy of future examination. ^ 

Beyond these specific and narrow hypotheses ,< our future research will 
continue to assess the whole spectrum of social interaction via FORUM as 
compared with other communication modes. We have found that FORUM enables 
new kinds of communication. One reason is that, in moving from face-to- 
face conferencing to teleconferencing via FORUM, a person enters what may 
be -called an altered communication state. Communicating via FORUM is thus 
likely to involv' a qualitative shift ^.n the individual's experience of 
communicating due to such novel factors as the time delay of the system, 
the written interactive mode, the absence of visual and non-vecbal cues / 
the physical presence of the temninal, and the behavioral requirements of 



Table 7. Tentative Hypotheses for Further Test-ing ' 



TENTATIVE HYPOTHESES ABOUT' 
COMPUTER-BASED TELECONFERENCING 


RELEVANT INDICATORS 


There is a lower tendency to digress than in face-* 
tO"face modes . ' - ^ 


Medium, Frequency of 
d igression 


For most persons, the total number of messages 
submitted is greater than in face-to-face 
interact ion . 


Med i um , , Part i c i pa t i on 
rate. Individual 


Affective feelings are not easily expressed. 


Medium, Ease of ex- 
pressing affect 


It leads to greater explicitness than other media, 
especially in decision-making. 


Med i um, Expl ic i tness , 
Task 


It produces a higher degree of horizontal role in- 
teraction than does face-to-face. 


Med i ura , Commun i ca t i on 
structure 


It is preferred to travel for tasks involving in- 
format ion exchange. 


Medium, Acceptance, 
Task 


It is preferred to other media when wide partici- 
pation is desired. 


Medium, Acceptance, 
Group size 


It leads to lower costs than other media for in- 
formation exchange in technical groups. 


Medium, Cost , Task , 
Group type 


The distribution of participation rates is differ- 
ent for large and small groups. 


Group size. Distribu- 
tion of participation 
rates 


The proportion of messages devoted .to the desig- 

iiaLcu LabK lb j 1 Lively uurrclaLcLl WILH tne Q6 

gree of familiarity with the medium. 


Familiarity with medium, 
Proport ion of messages 
devoted to designated 
task 


Previous acquaintance with other group members in- 
creases satisfaction with a conference. 


Acquaintance with group. 
Sat isfact ion - 


The facilitator of a conference tends to rank high 
in private message sending and receiving. ' 


Role, Private participa- 
tion rates and ranking 
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Table 7 (continued) 



TENTATIVE HYPOTHESES ABOUT 
COMPUTER-BASED TELECONFERENCING 



RELEVANT INDICATORS 



Across individuals, rank for participation in pri- 
vate mode is C9rrelated positively with rank for 
participation in public mode. 

Across individuals, there is a pobitive correla- 
tion between frequencies of comments judged "new"' 
and ••provocative."''*' 

Across individuals, there is a negative correla- 
tion between frequencies of '^new" and "s/nthetic^' 
ideas.''* 

The extent of humor is correlated w'th its degree 
of privacy. 

For a given individual, the average length of pub- 
lic and private messages varies with conference 
topi c. 



Across conferences, the overall frequency of pri- 
vate messages varies with task. 

Increased task structure increases user satisfac- 
tion with the outcome. 



The ratio of public to private messages is not 
uniform across conferences. 



The average length of messages is greatest 
beginning of a conference. 



at the 



Direct questions to other participafits are more 
likely to receive at least one response than 
dther message types. 



Private participation 
rank. Public participa- 
1 t ion rank 

Frequency of •'new" 
ideas, Friequency of. 
"provocat ive" idears 

Frequency of •'new'^ 
ideas. Frequency of 
••synthet i c" ideas 

Privacy of conference. 
Humor 

Topic , Characters/pub- 
lic message, charac- 
ters/private message. 
Part i c i pant 

Task, Frequency of pri- 
vate messages 

Extent of task struc- 
ture. Satisfaction with 
outcome 

Number of public mes- 
sages. Number of pri-, 
vate messages 

Time, Length of 
messages ; 



messi 
Type 



of message, \i\x(j\- 
ber of responses , 



-According to coding categories desc/ ibed on pp. 



Table 7 (continued) 



TENTATIVE HYPOTHESES ABOUT ' ^ 
COMPUTER-BASED TELECONFERENCING 


RELEVANT INDICATORS 


Messages directed to another participant are un- 
likely %o evoke muliipte responses. • ^ 

The distribution of message lengths is similar for 
public and private messages in the same conference. 

^« / 

For a given participant, average message length is 
greater for public than for private messages. 

More public messages are submitted than private 
messages. 

Participation rates in teleconferencing are heavily 
skewed, with most participants entering relatively 
few messages. 

The growth pattern of conference inputs is not uni- 
form across conferences. 


Type of message, Number 
of responses 

Privacy of messages, 
.Distribution of message 
lengths 

Privacy of messages," 
Average message length. 
Part icipant 

Privacy of messages, 
Frequency of ^messages 

Distribution of Parti- 
cipation rates. Medium 

Conference growth curve, 
Med ium 



i'i.4 

1 
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the program. The gestalt constructed from these characteristics feels dif- 
ferent from- the >\i sua 1 face-to-face communication. 

.'Such an altered state is usually set off from a person's normal behav-^ 
lor^ and learning, as though it is surrounded by a boundary line which 'keeps 
out previously learned behaviors ^nd allows new behaviors to be learned 
within a free space, what is learned within the new gestalt is associated 
with it and may not be easily accessible outside that state. This phenome- 
non has been found in experimental studies using drug-inducQd states and is 
also true for conditions ranging from dreaming to classroon learning* 

To t\}e ^extent that such a state occurs in FORUM teleconferencing, we 
would expect it to kave these characteristics: 

/ 

1. previous habits ^nd patterns of communicating will be less auto- 
matically available and will be reduced in strength. Generali- 
zation effects from other communication conditions will be re- 

, duded. (^'Generalization effect*' , refers to the tendency to carry 
over habits learned in one situation to another, similar one,) 

2. Interest and excitement will be initially experienced, along 
with confusion, anxiety, and uncertainty, according to individ- 
ual personalities. Many people will probably become more re- 
sponsive to external cues such as instructions. 

3. Because the user will not be familiar with the mode, he will 
have to learn how to comraunicate via FORUM. 

4. New modes,, styles, or patterns of communication and thinking 
can be learned more easily and with less resistance as -^the per- 
son learns to use FORUM. 

5. New norms and rules of communication can be established, or 
previously learned ones can be transferred and modified. 

The extent to which FORUM produces the above characteristics depends 
on the individual user and can be enhanced or reduced by the method of pre- 
senting teleconferencing to th^ user, by the instructions which' are given, 
and by any training or teaching which is offered. 

Given the potential altered-communicat ion state, the opportunity is nw 
available for consciously altering present habits of conference communica- 
tion and exploring new ones. This opportunity might involve different ways 
of exchanging information, new techniques of reading, methods of interpreting 
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data, the fonaation of new styles of expression, multi-level messages, crea- 
tive thinking and problem-solving, and techniques of resolving disagreement. 

Observation of conferences using FORUM already suggests some new modes. 
One, for example, can be called multi-stream (or multi-topic) communication 
(as described in Section III-C) , in which two or more topics are discussed 
'Simultaneously and with more or less coherence. This is possible with 
FORUM due to the time delay of the system and the adaptation of the users 
to the multi-stream pattern of thinking. This pattern wo\ild not be common 
or even accepted in a face-to-face conference and would likely confuse the 
conferees. In the gestalt of FORUM teleconferencing, however, the pattern 
can be learned without the strictures and inhibitions of face-to- face norms;.; 

A second example of a new mode of communication is the time delay it- * 
self. On one hand, this delay could lead to boredom and distraction; but 
on the other, it often enables the user to expand his sense of time. 

Because of the reduction in immediate feedback and non-verbal communi- 
cation, there is freedom from immediate negative reactions to contributions; 
that is, negative social reactions are reduced compared to face-to-face com- 
munication. People who are inhibited by overt negative reactions might 
therefore become more expressive in teleconferencing. Similarly, subjects 
which are tabooed or whose discussion is inhibited in face-to-face communi- 
cation might be more easily discussed in the changed gestalt of FORUM. This 
possibility suggests some potential uses for FORUM, including communication 
between therapist and patient or husband and wife, discussions of values, 
analysis of assumptions or premises, group psychotherapy, and encounter. 
Since such conferences would be occurring through the cognitive level of 
language, the emotional and behavioral effects would have to be evaluated 
as Well, 

We view our work with FORUM as an indication th^t computer conferenc- 
ing stands at the point where it can be usefully applied to research and 
business situations. Exactly when and how this application takes place 
will depend, in large part, upon developments in other fields — the escala- 
tion in travel costs, the general state of the economy, the availability of 
inexpensive terminals, and the growth of data networks. ^ 
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Our understanding of the human factors involved in the use of computer 
conferencing and of the psychological parameters will not match our under- 
standing of the technical problems until more research of the type conducted 
and reported here can be performed and analyzed. 

Finally, any forecasting of likely social effect deriving from compu-- 
ter conferencing will have to take into account not only the considerations 
listed above but also factors such as the growth in demand for information 
services to hones and neighborhood office centers, the possible recurrence 
of disruptive energy "crises", and the long-term reduction in the cost of 
computer hardware. 

The propositions we have formulated and, to some extent, tested in the 
FO^UM context indicate that computer conferencing may indeed have an impact 
not only, on travel costs but, more importantly, on the structure of organi- 
zations, either in facilitating direct dissemination of information or in 
promoting horizontal idea exchange. This Impact may be felt within two to 
five years In the Improvement of planning, policy- formulat Ion , and crisis- 
resolution tools. The effect may widen on this basis to Include such di- 
verse activities as citizen participation In planning, resource sharing In 
education, and the establishment of a permanent medium for the retrieval 
and dissemination of knowledge* Such a medium would be unique among' 
computer-based information systems in that it would include the basic units 
of knowledge — humans themselves. 

\ 



APPENDIX 1: (^tOWTK CURVES AND PARTICIPATION HAPS 



# 



Care should be taken in mking direct comparisons between growth curves 
from individual conferences, since the conferences vary in length and the 
logistics of graphic presentation also vary* 
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Figure 26. Growth Curve for the FORUM Stoff Meeting (C2) 



-114- 



J 




Figure 2?. Growth Curve for the Experimental Design Conference (03) 
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Figure 28. Growth Curve for the IFTF/XYZ Conference (C^) 
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Figure 29. Growth Curve for the WPO Conference _(C5) 
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APPENDIX 2 
INITIAL INTERVIEW SCHEDULE 
August 1973 



Since you are part of the first group to' have any extended experience with 
FORUM, we would like to record your reactions and criticisms. At this point, 
we are particularly interested in your criticisms of FORUM as it is now — as 
well as the potentials you might see for the program. 



General question: what are your overall impressions of conferencing using 

FORUM? 



PROBES: What about computer conferencing in general? 
Positive : 

f 

Negative : 

What about FORUM specifically? 
Positive: 



Negative: 



How frequently did you get hard-copy transcripts of the 
conference sessions? 
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How did you use these transcripts? (e^g*, read care- 
fully, skimmed, made detailed comments in reaction, 
etc* ) 



How did you use the actual time you were in the FORUM 
program? (e.g., responded immediately, only skimmed 
other comments, etc.) 



GENERAL QUESTION: How has your group changed since you began using FORUM? 

(Try to be as specific as possible.) 



PROBES: How much of this change do you feel was related to using 
FORUM? 



ERIC 



What about negative effects of using FORUM? 



What about positive effects? 



How have your face-to-face meetings been different from 
the FORUM conferences? 



Do you think your FORUM conferences could have been con- 
ducted as well using some other technique? (Try to be 
as specific as possible.) 
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GENERAL QUESTION: What do you see as the most beneficial applications of 

FORUM in the near future? 



How are your typing skills? 




"132- 



INSTRUCTIONS 



Please read carefully 



The following scales are designed to assess feelings and attitudes toward 
various communications media. There are 24 scales altogether. Even if some 
of them seem strange, or inappropriate, it is very important that you com- 
plete them all. 



Please consider 



FORUM as a communications medium* 



You have just had a discussion using FORUM. Please don't think about the 
discussion itself, but consider the actual mediim that you used for the 
discussion. 



Work rapidly through the scales, without pausing for more than a few seconds 
on each one and without returning to one you have already completed. You 
shouldn^t take more than 2 or 3 minutes to complete the whole set. 



While, considering 

I FORUM as a commfunications medium, 

please place ^ check at the point on the scale which you consider to be most 
appropriate. 



boring 

colorless 

complex 

constricted 

excitable 

free 



interesting 

colorful 

simple 

spacious 

calm 

constrained 
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good 

important 
meaningless 
passive 
periodic 
pleasurable 
public 
repul^le 
sensitive 
soft 
stable 
strong 
* tenacious 
true 
ugly 

unsociable 

unsuccessful 

small 

friendly 

impersonal 

technical 

relaxed 

informal 



bad 

unimportant 

meaningful 

active 

erratic 

painful 

private 

disreputable 

insensitive 

hard 

changeable 
weak 
yielding 
false 

beautiful . 

sociable 

successful 

large 

hostile 

personal 

non-technical 

tense 

formal 
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